Married Filing Separately Penalty

I am a widower who remarried in October 2019.  But we didn't start living together until March 2020.  I paid no taxes on my social security in 2019, but over 50% of my social security became taxable in 2020.  What is the logic for penalizing me for living with my wife?