I lived in an apartment on California and Pierce and another apartment on California and Baker.
In the first apartment, there really wasn't a gym nearby. A few studios, but no gym. Also, the closest grocery store was Mollie Stone ($$$). The California 1x or 1bx runs often and are very fast.
I felt safe around Fillmore, but it gets a bit shadier going towards Geary. The demographic is affluent professionals, mostly mid-20's to 40's.
In my second apartment, I had a hard time catching cabs. I would go to the Jewish Community Center to gym and Trader Joes to grocery shop. I still felt safe, but would be cautious.
Hope this helps, let me know if you have any additional questions!
Ali, Community Manager