How should I complete W4 upon birth of newborn child?

We were was blessed with a son on 11/04. Currently, number of exemptions in my Federal and Michigan state W4 are 3. Should I bump this to 4? Also, how should I answer Tax Exempt Indicator question- "exempt, reportable" or "no exempt"?