Currently pregnany and Due Dec 28- W4 vs filing taxes

Hi,

I am currently pregnant and due date is Dec 28, 2024. Since the baby is not born until the last few days of this year, do I need to change anything on my/our W4 now?  Since the due/birth date is this year, won't the baby need to be filed as a dependent when we file our 2024 taxes? I'm not sure if this is considered similar to marriage (if married last few days of the year, then considered "married" the whole year). We've been married one year.