As a former realtor, what was your credit score at the time you signed the mortgage documents? If your interest rate is 4.75%, I know lenders charge additional fees and/or a higher interest rate to buyers with low FICO credit scores, little savings or any previous credit problems. This is a way of lowering the lender's risk and "punishing" the buyer because they want to move forward and buy a home.
Buyers with high credit scores, savings and no past credit issues are always offered the lowest interest rates and no additional fees.
This is why I told buyers to wait, improve their credit first then buy a home.