Will an offset delay my refund if I already have a direct deposit date?

No, there should not be a delay and your remaining refund should process as normal.

https://ttlc.intuit.com/replies/4143297