Your federal refund will not be affected, since the DL number is not required to file your federal return.
Your state refund may be affected, as states require DL as part of their ID requirements. It depends upon the state and their particular rules. If you were not expecting a state refund, don't worry.
