We are not married and he is 6.

You are assuming he is the custodial parent with your answer. We are both custodial parents though, meaning we have both joint legal and physical custody, and I...