Correct. There is no penalty for early withdrawal on a conversion from traditional IRA to Roth IRA.
There will be a 10% penalty for early withdrawal if you withdraw the converted funds in less than 5 years, except that if you are over age 59-1/2 when you make the withdrawal, there is no penalty even if it has been less than 5 years.