Are you actually self-employed? If so, you are required to pay self-employment tax on self-employment income of $400 or more.
See https://www.irs.gov/businesses/small-businesses-self-employed/self-employed-individuals-tax-center
[note that the social security/medicare contributions paid by your employer are irrelevant for this purpose]
