You are asking about what to say on your W-4 at work for the amount of tax to have withheld? If you also claim an allowance for your step-daughter you risk having too little withheld, but try the IRS tool for calculating what to put on your W-4:
https://www.irs.gov/individuals/irs-withholding-calculator
When you file--presumably you will file a joint return with your new spouse for 2019 when you file next year--if it is his year to claim his child, the child will be listed on your joint return.
You have not mentioned which parent is the custodial parent. The custodial parent is the one who gets to receive earned income credit and the child care credit; the non-custodial parent can get the child tax credit.
**Disclaimer: Every effort has been made to offer the most correct information possible. The poster disclaims any legal responsibility for the accuracy of the information that is contained in this post.**