The amount will be repaid from whichever revenue department the agency requested the offset from. It could come from federal, state, or both. Both returns don't need to be completed for the refund to be offset.
