If it's a Traditional IRA, yes you do. However, up to $10,000 of the withdrawal may be exempt from the 10% early withdrawal penalty if was a first time home purchase.
