Should I be worried if the states hasn't taken the money out of my account

To make sure that your payment is indeed scheduled, you can always reach out to your state's department of revenue for reassurance. Here's how to do so: How do I contact my state Department of Revenue?

Was your state return accepted?  Better double check.
https://turbotax.intuit.com/tax-tools/efile-status-lookup/

Then Check the printout or PDF of your return; look for the state cover sheet with the Turbotax logo.  If you owed tax, it will show the payment information and how/when you decided to pay.  Read the state payment instructions carefully since most states cannot be paid from within the TT system and requires additional steps.
https://ttlc.intuit.com/questions/1900884-what-are-my-options-for-getting-my-state-refund-or-for-paying-any-state-taxes-i-owe