Yes you can certainly mail them both at the same time. You would need to mail your Federal tax return to the IRS and your state return to your state tax agency. Please be sure to follow the instructions that printed out with your tax returns, this will tell you where you should mail your Federal return and state return.
