Yes, you will be able to claim the child as a dependent on your 2021 tax return. You just need to indicate that the child lived with you for the Whole Year since the child was born in 2021.
A spouse is Never a dependent. You should be filing your tax return as Married Filing Jointly even if one spouse has little or no income.
