There are always buyers that object to neighboring property, whether it be the color of the house or the height of a fence. In your case, there are more components of the neighboring property that increase the likelihood that the neighboring property might bother a potential buyer.
I have also hear of neighbors of the growing operations that say that the security is a plus.
I suggest you do what you can to mask the effects of the neighbor. Plant tall evergreens to hide the plastic, plant fragrant flowers to mask the odor, and ask your neighbor if they can do anything about the odor.
I think that overall most buyers would be concerned about resale value, and that will probably impact what you get for your home.