The bank will refuse the direct deposit and the IRS will issue a paper check and mail it to the address on your tax return. I don't know how much longer it will take.
