Yes. If you are younger than 59 1/2, such withdrawal from a 403(b) account will be subject to the 10% early withdrawal penalty.
For qualified higher education expenses, only early withdrawals from IRA accounts are exempted from the penalty.
Please read this TurboTax article for more information.