Deductions & credits

Question is: do I have to pay them back for the years they didn’t withhold the FICA taxes? We are talking about 4 years and amount 27k. Is that legally right?