Don't enter zeros, leave it blank.
The exception is if there is a number in column A for a particular month but not anything in column B. In that case, you need to look up the number for column B.
https://www.healthcare.gov/tax-tool/#/premium-tax-credit
