Before the rain comes in today try the Ferry Building. Get some Hog Island oysters and watch the ferrys come and go with a great view of the bay. Next door is The Slanted Door for modern Vietnamese food and cocktails, nice view. About 100 yards away is Hardwater on Pier 3 one of the best bourbon bars anywhere. I've never seen so many bourbon options and they have tasting flights.
The homeless issue is a sad one. So is the dirt and smell along many of the busy streets.