If the stipend is small it's not likely that you have to have additional tax withheld. But if you want to be sure, you can use the Tax Withholding Estimator on the IRS web site to check your withholding. It's a good idea to check it once a year even if nothing has changed.
Tax Withholding Estimator