You would be taxed at your marginal tax rate on the income portion of the withdrawal plus a ten percent penalty tax on the same income portion of the withdrawal. When you take a distribution, you are considered to be withdrawing the principal first and later the earnings. So, if you didn't withdraw more than you contributed there would be no tax or penalty.