I assume you two got married in 2019?
what refunds are you referring to? state tax refunds? if he filed using the standard deduction in 2018, then the refund is not taxable income (same for you).
if he filed itemized, it gets messy because of SALT. the refund may be taxable and may not be,