Only the interest paid on the delay in processing is taxable on the federal return. When you are completing the state return the fed refund may be taxable.
