Yes. And you didn't exactly need to pay over the year. You were suppose to send in quarterly Estimated payments to cover the tax due on your return. It was not the actual tax but like withholding from paychecks.
It's all reconciled on your tax return. The SE Tax is included in the tax due on your return.
