California is a NON-RECOURSE state:
The holder orf the 2nd can bully and bluster, they can call you all the time, but they cannot sue you.
Be sure that they do not put anything more on your Credit Report; tell them that you will sue them.
If they persist, call a Real Estate Attorney; it will be cheaper than paying them.
Good luck and may God bless