"it seems it goes off of what you paid SE/FICA taxes on"
Not exactly, but that's a rough indicator. For example, someone filing single and whose only compensation is less than $433 of net profit from self-employment does not pay any SE tax but can still make an IRA contribution.
