If by "tax was paid" means that you had taxes withheld from the distribution, if you did not substitute other funds to be able to roll over the entire gross amount of the distribution, in addition to being subject to ordinary income tax, the amount withheld for taxes and not rolled over is subject to an early-distribution penalty unless an exception applied.
