Should I change or stop my pension tax withholdings since my state now exempts pension income in 2022?

Yes, if your federal AGI is less than $75,000 if filing single or $100,000 filing married jointly. 

Thank you so much for your response Bsch4477! 

Maybe this is obvious, but be sure not to stop your federal withholding.

Thanks so much TomD8, yes unfortunately the Federal taxes need to stay :(