When you e-filed, you would have chosen a date for the withdrawal up to the due date. If you didn't specify a withdrawal date (or even if you did), it can take as long as the IRS takes to process your return. The IRS website site, says most returns are processed within 21 days from acceptance.
Call IRS e-file Payment Services 24/7 at 1-888-353-4537 to inquire about your payment, but please wait 7 to 10 days after your return was accepted before calling.
https://www.irs.gov/uac/Pay-Taxes-by-Electronic-Funds-Withdrawal