I withdrew from 401K and selected to have state and federal taxes pulled from amount I withdrew - am I required to pay back over three years? I have a different 401K now

Both state and federal taxes have been paid on amount pulled. I don't work for that employer who I had the 401K under. Why would I have to pay this back