Realtors do not have the ability to force a buyer to buy a particular house. We often list multiple homes at the same time and top agents often have 2,3 or even 4 homes listed in the same neighborhood if not the same street.
The work a Realtor puts into selling your home should be equal to the work they will put into the others. In fact, have two homes listed on the same street will usually result in increased marketing if the homes are both similar in price and size. For instance; If I am showing house A on Smith St. and I know house B is similar, I will also want to bring the buyers to house B even if they did not request to see it.
Some common examples of a Realtor Conflict of Interest would be; The Realtor wishes to buy the house they have listed. Another common one is having the listing agent representing both the Buyer and Seller for the same property.
The best way to work out a conflict is to avoid it. But when unavoidable, put everything in writing. In your situation, it does not sound as a conflict.
Good Luck with the sale and remember to Price it Right for Today's Market