My wife and I both received letters showing the same amount of advance child tax credit payments we received. Are those amounts meant to be combined when filing jointly?

It will work either way but you can report them as described on the letter. 

those amounts are intended to be entered in the boxes provided for you and spouse, respectively.

See the entry screen ... follow the instructions :