We have two form 1098s from buying our house this year. Do we only put insurance premium down once if it is on both 1098s?

Yes, if it's a duplicated amount then you'll only list it once.  If for some reason each figure represents half what you paid -- half shown on each 1098 -- then you'll enter both.