Depends...you'll need to discuss the contract terms with your agent and see if it's possible. Keep in mind, if you have a rate locked, you may not get the same rate with another lender, you'll also have to pay for another appraisal, credit report, application fee if one was charged.
In general, 15 days is a VERY tight timeframe and irritation is a bad reason to switch and may put your contract in jeopardy. You're in a competitive market, so probably best to suck it up and move forward.
Good news is that it's unlikely you'll deal with your loan officer again after closing. Depending on what bank you're working with, they probably won't 'own' your loan more than 30 days past closing. Unless you're already working w/Wells Fargo or Bank of America. It's likely that your loan will be sold to one of the larger servicing companies. Even if your loan officer is with a big bank, the loan servicing arm of each bank is often an entirely different entity.
Best of luck!