Yes, you can choose to mail your taxes owed by check/money order and mail your payment before the filing deadline in order to avoid any penalties for late payment.  

If you have already e-filed your return, you can also make your payment for taxes owed directly to the IRS or your state's Department of Revenue.  You will need to pay your taxes owed no later than April 17, 2018 to avoid penalties. You can pay your taxes owed by visiting the following IRS link: https://www.irs.gov/Payments