Find another partner? He wants a bigger place? Fine! Co-own it with him...and rent out your place!
As mentioned by Robert, as long as you are not on the note or the mortgage currently then you should not be affected by this. It is not uncommon for someone to be on the DEED of a home and not the mortgage.
Real Estate Agent and Title Insurance Producer.