"charged from the IRS"
Do you mean the IRS is debiting your account ever month? Or mailing you a bill ?
Did you have a balance due on your return? If so did you fill in the 9465 at the end of the program to get into a payment plan maybe by accident ?
And if scammers have your bank account info then they would take much more than a buck or two if you had more in the account to grab.