Probably.
A 401K usually consists of employee pre-tax contributions and matching employer pre tax contributions. After tax contributions, by the employee, are also allowed. Only if you made sufficient after tax (essentially non deductible) contributions that exceeded the amount you withdrew, then you would be allowed a deduction.
There's another technicality you should be aware of; you must have removed all traditional IRA funds, not just this one account, to get a deduction and also not have the distribution not be taxable.
