State tax filing

Understood, it is also inconvenient for me to file quarterly estimated taxes, and creates an issue with my families filing each year, I'd rather have my employer withhold these taxes straight away. 

 

If technically they are required to withhold, is it illegal NOT to do so.  Or can they continue to get away with this stating its inconvenient for them to do so?