After a lot of different attempts, I've had success with RRL Officer Chinos, Unis, Incotex, and Hickey (not Freeman). Good construction and materials on each.
As others have mentioned, RRL is a wonderful pair of pants. Unis has a uniformly slim straight cut that is very versatile, although their cuts have changed recently to be more tapered. Incotex also makes a great flat front pant that is reasonably slim without being crushing, but for me, it straddles the line between totally casual and something a little more polished, so it doesn't get as much wear.