So I claim a number of 2 allowances on W2 and not sure why my refunds are so low. I do work for the state of colorado

I pay into medicare but do not pay social security but am I missing something?