If we do married filing separately and want to efile our state returns (we are using CD/Download - the state is the same in both cases), do we have to pay 24.99 twice?

Yes, you would both need to pay the state e-file fee.  The alternative is to e-file federal and print and mail the state.  It will give you that option at the end for most states.