You'd have to file a part-year or non-resident OH return to get a refund of the OH tax withheld.
You may not be REQUIRED to change your state tax withholding to CA, but the Ohio Police and Fire Pension Administrator IS REQUIRED to stop OH withholding upon a written request from you.
