With some buyers your property may only have one chance to make a good impression. Put on your buyers hat and look at your property as a buyer. That should give you the answer you are looking for. If that does not help, try going out with an agent and looking at what other similar properties on the market ( your competition) look like to find out. Buyers want the nicest home at the least price or best value normally.
All the best,
Don't worry about the paneling, they might even like it.