I live in Kansas but work in Missouri. Should I fill out a W-4 form for both states?

I live in Kansas but work in Missouri. Should I fill out a W-4 form for both states?  I just want to be sure.  My employer didn't sound sure.