If they take money out of your account that was owe to federal. But the returns was rejected will they release the funds back to my account or will it stay pending?

If you requested to pay the federal taxes owed by direct debit from your bank account and your e-filed tax return was rejected by the IRS, then the IRS received no information concerning the debit payment so nothing will be paid.

You only need to fix the rejected tax return and e-file again.