How does retiring early affect my social security payout later?

Hello, I accepted an Early Retirement Incentive last year at age 53 and started collecting a pension. How does not working before you start collecting Social Security affect the payment?  I plan to start collecting Soc Sec in 13 years. Should I return to work before a certain number of years to avoid a big drop in the payment? Also, I plan to work part time, how does working at a lower income affect the payment?

 

Thank you!