My job states I don't make enough to have federal taxed withheld but I have 2 dependents. When I fill my taxes will I owe?

Should I amend my w4 and withhold a set amount myself? I recently changed jobs in June.