Yes, you do it as you describe.
But, If your tenant is reimbursing you for utilities, you should be reporting that as rental income. Then you deduct what you paid the utility company as an expense, on Schedule E. Unfortunately, the IRS will be expecting the income on line 21 of Schedule 1 (or schedule C if your worked for that $).
How does utility reimbursement "involve work"?
