If the basis of a non-deductible IRA is sufficient, can a distribution be fully non-taxable on F8606 or is it always partially taxed until basis is zero?

Ignoring QCDs and HFDs which come from the otherwise taxable part, it's always part basis and part taxable until you have nothing left in traditional IRAs (or your balance becomes less than than your basis because of investment losses reducing your balance).