Try to Delete your 1095-A and re-enter it manually.
You are correct that all boxes without amounts should be blank, and not have $0's in them.
This can happen if you downloaded your 1095-A.
On the left-side menu, choose Tax Tools > Tools, then 'Delete a Form' from the pop-up menu.