Your state residency isn't determined by your driver's license. It's determined by the location of your main or primary home, which is known as your domicile in tax terminology. If your main home has been in Florida for 4 years, you've been a Florida resident for 4 years.
BTW, Florida law is that you must obtain a Florida drivers license within 30 days of establishing residency in Florida.