You can also deduct any points you pay, and the IRS will allow you to deduct your loan origination fee if it is expressed in terms of "points"; just make sure it is listed on the HUD-1 as points. Also, if you can get the seller to pay points for you, they are tax deductible for you, not the seller.
The only other thing I would add is that if you plan to use part of your home for business, you can deduct certain expenses (a portion of your utilities, etc.) from your yearly taxes and you can also take a deduction for depreciation on that portion of your house. The only draw back is that when you sell, you will be subject to a recapture tax - on the depreciation portion only.
You should consult with a CPA and/or tax attorney before making any decisions.