If you own your home free and clear and the person with whom you want to swap does also, you have a chance.
If not, you have the loans to deal with and it can get sticky. Unless you made a big down payment, chances are your home is worth less than you owe today. Even if you could find a willing partner, your respective banks won't let you just substitute him for you.
I don't know if the website mentioned in the first answer, collects an upfront fee, but in this market you have very little chance, if any, of just exchanging.
If it does work out, let me know, I'm always willing to learn.

Jj,

You can view the following website: http://www.ree.com.

They are a nationwide property exchange service. You can also go on and "google" "Property Exchanges" and will bring up numerous sites to preview.

Good luck!