You won't lose your carry over losses. However, you will have to prorate your expenses if you use your rental property for personal use more that 14 days in a year.
You can learn more about that here:
Renting Residential and Vacation Property
