I am self employed & paid a non employee $2450 & gave him a 1099 NEC. I understand that I should have given IRS that info by feb. 1 Which form do I need to submit to IRS?

When transmitting the forms to the IRS, you must include Copy A (Red Copy) of the 1099-NEC, along with the summary page Form 1096 (Red Copy). 

For additional instructions: IRS: Reporting Payment to Indepdendent Contractors