CA taxes being withheld but I work remotely in GA - can I get CA tax refund ?

Hi, I started to work remotely from GA for a CA based company from 2021 April. Somehow I missed changing the residence state and my employer has been withholding CA tax till now. I am planning to move to CA in Nov. Can I get the CA taxes refunded as I never resided in CA ? Is it illegal to not withhold GA tax as I reside in GA ?

Thanks,