You're fine, as long as you stay out of the Tenderloin, or any of the neighborhoods where there are fabric stores, because it's some sort of law that fabric stores have to be in terrible neighborhoods.
Oh and if you feel adventurous, take caltrain (I think it goes there) to Jack London Square in Oakland and hit Home of Chicken and Waffles. Best Soul Food ever.