It seems that there was a proper distribution from the 401(k), so I don't think that it's possible to avoid taxation of the distribution.
Depositing it into a Roth IRA as a rollover is a transaction that is not permitted to be undone. What was the reason for the Roth IRA custodian rejecting the deposit?
