Yes, the bank could come after you for the difference. Example would be if you owed 120,000 and you sold the house for $115,000. Then technically you owe the difference of $5,000.
Generally, you could try to negotiate with the bank to "forgive" the difference. If the bank agrees, make sure you get it in writing.