You can't include labor for these items.
You can make a reasonable allocation (estimate) of what the materials alone would have cost. If audited, you would have to show how you determined that your estimate was reasonable. For example, what would similar doors and windows costs if you bought them at a DIY store to install yourself?
