the IRS says it will have a portal later this year where you can inform it about newborns in 2021. if the child is already listed as a dependent on your 2020 return you need do nothing.
https://www.irs.gov/credits-deductions/advance-child-tax-credit-payments-in-2021