If these improvements cost over $2,500 you would list this as a remodeling asset on the deprecation schedule and take deprecation for them.
If less than $2,500 they can be expensed.
Yes, this remodeling costs will be considered (for any gain or loss) when the property is sold as a future date.
On the Rental section, when you go to Rental Summary you will see the Asset/Depreciation section and this is where the remodeling cost can be added. I have attached a picture of the screen you will looking for.