Yes, a withdrawal from a 401(k) is taxable income and there are no exemptions from the 10% early withdrawal penalty for home improvements if you are under age 59 1/2 or under the age of 55 and separated from the company that provided the 401(k).
Even if there was an exemption from the penalty the withdrawal is still taxable income.