Yes, the cost of finishing a basement would be a home improvement and should be added to the Adjusted Basis of the home when being sold.
