Investors & landlords

I intend to rent the home again when my clean-up work is done--in fact, I already have a tenant lined up.  

 

I'm just curious, though--when I get too old to take care of this rental home, I will probably use it instead for my grandkids to stay in for extended visits.  How would that work--if I don't rent it/don't sell it?  Will I just stop preparing the Schedule E without any consequences from the IRS, and wait until I sell it (or my estate sells it) and then worry about the depreciation recapture/etc?  

 

In advance, thank you for your advice.