Depreciation recapture on rental property

I have heard that even if I don’t depreciate a rental property, I still need to recapture depreciation when I sell the property.  I’ve depreciated on my taxes about 3 of the 8 years I’ve rented.  Can I just recapture the amount that I depreciated when I sell or do I need to recapture what I should have depreciated?