Yes, the expenses to construct the additional dwelling unit (ADU) can be depreciated.
Add the ADU as a new rental property asset in the Assets/Depreciation interview of Rental Properties and Royalties. Don't show any value for the land, since it was already accounted for (excluded) when you entered the cost basis for the principal rental unit.
