if you convert, as you said, non-deductible contribution to a Roth, and your IRA(s) balance afterwards is not zero, then Form 8606 is required to calculate the taxable amount and new basis.
The new basis will also be non-zero.
