Your position is exactly the same as a lot of homeowners,
and it doesn't seem to make a lot of difference whether there is a house on it or not.
If it is going up to $400, it must be going up a couple hundred $$.
Only you can decide if it is worth it to keep the property and your credit.
Good luck and may God bless