It's not advisable to stop paying your fees and we would suggest that you review any type of action with an attorney.
Try getting a group of owners together that share your concerns and attend a meeting. Request to be put on the agenda and present it as a group action. "The squeeky wheel gets the oil."
We agree rules are made to be enforced.......