If my taxes were rejected, will the amount due still come out of my bank account on the day I specified?

[DDollar]

No.  If your tax return was rejected, the IRS (or state) will not draft your tax payment from your bank account.