This IRS document concludes with this:
Conclusion
Remember, compensation paid for election worker services is included in income, and may be subject to income tax and FICA taxes as well as reporting requirements.
However, election workers may be exempt from Federal Income Tax Withholding.
Page 47 of IRS Publication 15 includes this chart referring to election workers.