if my billing amount is for the total of new windows do I enter all of it?

Are you entering information for a home energy credit?  You enter the amount that you paid for the total for your windows.

For more information, please review the TurboTax article How Do I Add or Remover Form 5695?