If you worked more and made more income, it is possible that you are in a higher tax bracket. It is also possible that you lost credits due to a higher amount of income.
Additional reasons for decreased refunds are:
If you would like to reevaluate your income tax withholdings, you could enter your information on the W-4 Withholding Calculator to get to your desired result for the next tax year.
Your tax refund is a function of the difference between your actual tax owed and the amount of money you pre-paid toward that tax. It has nothing to do, directly, with how much you worked. It's not a "prize" for working, it's simply a return of your own money that has been sent to the government to ensure your taxes are paid.