If I am not sure whether the other parent claimed one of our children on their income taxes can I attempt to claim the child?

Yes, you can. If you e-file and your return is rejected it will tell you if it is because the other parent claimed the child on their taxes.