No, I don't think that is possible.
You are going to alter the vacant land by building on it.
So it is not like borrowing against a house in your case.
If you have enough income I don't see why you couldn't get a construction
loan and then after home is built. Take a loan or mortgage from a lender.