Can the IRS take my husbands refund if we file married filing separate and I owe money?

If we file joint, we owe around $5,000.  If  we file separate my husband would get back around $3,000 and I owe around 5,000.  Would the IRS take his refund to put to what I owe?