Be very careful! Every situation is different. They are not always tax deductible, you should ask your CPA about what you can or cannot right off.
Some buyers pay points to buy down their rates. What you need to determine is if it's worth it or not.
Example, if your rate is 4% for a $500K loan w/ no points, and you pay 1 point= 1% is $5,000, how much lower will your rate be? 3.75 or 3.875???
That's the question to ask your mortage professional. The other question you need to ask yourself is how long you plan on keeping that property. Why pay an extra $5,000 upfront if the numbers don't work in your favor.
Best of luck.