Unfortunately, the amount that was withheld is considered to be a distribution to you, and thus taxable itself.
So, if the gross amount was $100,000 but only $75,000 was rolled over, the difference of $25,000 is taxable.
