You don't have to withdraw the money for individual expenses or even keep the money in a separate account. You just need to spend at least as much on "qualified acquisition costs" (closing costs, down payments and other reasonable and ordinary costs of buying a home) as the amount you withdraw.
