It technically qualifies for the credit, but NOT the entire cost. Only the 'extra' cost for the solar qualifies. For example, if the regular electric window costs $3000 and the solar one costs $3100, you can claim the solar credit on $100.
Here is some IRS guidance about it, but referring to a fan, rather than a window:
Q-29: Is an expenditure for a solar powered exhaust fan eligible for the § 25D credit?
A-29: Only the component part of a property that actually generates electricity for the dwelling unit is eligible for the § 25D credit. If a solar panel on a fan generates electricity to power the fan for use in the dwelling unit, the cost of the panel component may be eligible for the § 25D credit if all the requirements of § 25D are met; however, the entire cost of the fan is not eligible. Additionally, § 25D(e)(1) specifically allows certain labor costs to be taken into account when calculating the credit. Under this provision, a taxpayer may take into account only the labor costs allocable to the qualifying component when calculating the credit.
https://www.irs.gov/pub/irs-drop/n-13-70.pdf#page=11
