Refusing to live anywhere north of Bloor is daft -- if you take that literally, it rules out
Yorkville and the Annex! My rule of thumb was to live south of St. Clair; you're then technically within walking distance of most of downtown.
Why not try the Annex? It's not too expensive, plenty of shops/bars/restaurants, and I have good memories of hot summer days strolling along Bloor between Spadina & Bathurst (even if Dooney's is now gone, so I hear).
Whatever you do,...