Yes.
As long as you have not paid or filed, you can still delete a state return you do not need.
Go back into the state interview section.
You will see a list with Status of your state returns.
Simply select Delete to the right of any returns not applicable.