I've done contractor work before and never reported a deferral on my income. So I'm confused if this is something I need to pay or if this involves my employer at the time. Thanks.
If you were working for an employer in 2020, check your paystubs from March until December to see if SS was being deducted. If it was deferred, then you have to pay it back.
The CARES Act allows someone with self-employment income on their 2020 tax return to defer paying part of the Social Security tax that's included in the self-employment tax, if certain requirements are met. The deferral appears as a refundable credit on Schedule 3 line 12e. It was subtracted from the tax you had to pay with your tax return. Half the deferred tax is due December 31, 2021, and the remainder is due December 31, 2022.
TurboTax asked whether you wanted to defer the tax. See the screen shot below. If you clicked Yes it went on to calculate the maximum amount you could defer, and then asked you how much you wanted to defer.
You never did this before because the deferral is only allowed for 2020.
The IRS letter is about the self-employment tax on your tax return (on Schedule SE), not Social Security tax that is withheld from your pay by your employer. If an employer deferred any of the Social Security tax, the employer will collect the deferred tax in 2021.