If you take a Withdrawal it is taxable on your return and may push you into a higher tax bracket and more income can reduce or eliminate some credits you may qualify for and may make more of any Social Security or SSDI taxable. So be careful. Then there is a 10% Early Withdrawal Penalty if you are under 59 1/2. You can lose like up to 50% of it for taxes and penalties for federal and state.
For a IRA. You can exempt up 10,000 for the penalty for a new home purchase. And that is for each spouse's withdrawal.
For IRA under 59 1/2 early Distribution Penalty See IRS publication 590B for IRA Distributions Page 24 for exceptions
https://www.irs.gov/pub/irs-pdf/p590b.pdf
