Cost basis for a rental sale

If you make some improvements to a rental property, say put in new windows to the building, and claim those expenses in that year, can you use that improvement to elevate the cost basis later when you sell the property?