At the beginning of July the IRS is supposed to have a web site, or "portal," where you will be able to tell them about your new baby so that you can get the monthly advance payments of the child tax credit. No information is available yet about how this portal is going to work.
If you are not able to get the advance payments, you will get the credit on your 2021 tax return.