No the IRS will not force you out of your home immediately. However, the IRS can do the following:
They can garnish your income
They can place a lien on your home
They can foreclose on your home
If retired, they can reduce your Social Security income
They can seize your bank account
If you owe the IRS money, time to pay up.