Yes, you are correct. If your 2021 Adjusted Gross Income is below the maximum for receiving the Recovery Rebate Credit then you are eligible to receive the credit on your 2021 tax return.
A child born in 2021 is also eligible for the Recovery Rebate Credit.