Of course. If you went to work and did all your work you would expect to get paid. How would you feel if your boss said, "i decided not to pay you any more, I just forgot to tell you".
If you are unhappy with your agent fire him/her and move on. Don't verbally agree then try to get out of it.