Yes, that will also likely be a thing. When you file a California tax return saying you have no California income, they are likely to send you a letter making you prove it. It’s too late for this year, and it is more important to fix your tax return first, but you want to cancel your California withholding so you stay off their radar.
