Just responding to say that I found the solution in this other thread that I started. It turns out that you do need to enter it in both Federal and State because there is a separate state credit on top of the deduction but it has higher qualifying requirements.
Link to solution: https://ttlc.intuit.com/community/tax-credits-deductions/discussion/illinois-teacher-educator-expens...
