How long do I report cash out of loan that has since been refi'd?

The refinance we took out in 2019 we cashed out a few thousand dollars to pay off debt. We refinanced that loan in 2020. Do I have to continue to report that cash out money until we sell our home? Or only if we had that loan at any point in 2020?