Does it takes longer after you file to recreceive your taxes if you owe a debt to the IRS?

It's been 3 weeks already, should I be worried?