You are correct, but it's not just the voucher holders that have given the Program a bad name, it is also the strict requirements and unwillingness of the Program administration to hear much less understand reason. At least that is the circumstance which I have come to know in my area.
But, a good thing the program is now allowing is that Owners do not have to have their homes approved prior to having a Voucher holder look at the home. You, as a voucher holder, can initiate the process and bring Owners into the Program. So you will have the ability to sell yourself and then the program, which will ultimately pay a market rental rate based on other homes in the area.