Has the IRS actually released and sent the refund direct deposit?
https://www.irs.gov/refunds
If so, how long has it been since they sent it?
If the bank refused the direct deposit, it would go back to the IRS, who would issue you a check in the mail to the address on the return.
