It's not a gray area. Land is not a home. You need to close on the home that will be your primary residence within 120 days of the IRA withdrawal. The land is not your primary residence, unless you are living on it in tent while you build your house.