Pension income as a non-resident

I am a retired, full time resident of Tennessee, so I do not have to file a state return.

However, my pension comes from State of Georgia.  Every year I struggle with the question "I made money in Georgia, but I didn't live there."  Does the pension count as 'earned income?' 

Turbo Tax also has led me to believe that the only reason I have to file in Georgia is because I have withholdings on my pension.  If I cancel all withholdings, which I did mid year in 2022, will that cancel the need to file in Georgia? Will it cause 'red flags' on the Federal taxes?  TYIA