Gray is hard only when all you wear are gray pants. Like you, I wear a salt and pepper SC with light, medium, and dark browns and blues, various shades of olive, sage, and army greens, various reds and burgundies, etc.
Relatedly, I'm bumming around I one of my Despos coats (black and white herringbone), sage green cotton Rota pants, and Alden Indys under a navy single breasted Norwegian Rain coat. I look as good as Mr. Six.
There is a pic in the NMWA thread. http://www.styleforum.net/t/358758/no-man-walks-alone-official-affiliate-thread/30700_100#post_8343126 I saw the pic and bought the piece. Couldn't be happier with it.