Fire the agent! Before doing that, the HUGE question is did you sign a Broker Agreement or did you sign anything? If you did NOT sign anything, then you are free to find a different realtor and interview them carefully.
If you DID sign an Agreement, then you need to speak with the Broker in Charge or Office Manager and ask them to release you. They make the determination - not your agent. It also depends on how far along you are in the process. Example: if all your agent did was just show you a few homes, the Office Manager will release you easily. However, if you submitted an offer on a home and ready or in contract, then the Office Manager can assign a different agent within their brokerage to close the deal.
Bottom line - you can always work with a different agent within the same brokerage.