This is a difficult one.
I'm progressing from casual and the casual-with-blazer look, and I've recently taken a liking to chinos. I'm also more interested in matching colors, so I find myself wanting what other people would describe as a suit. The difference is that they would see it as dressing up for other people, and I see it as dressing the way I please.
Is it possible to wear trousers and a jacket in matching colors and fabrics without it being assumed that you work in an office, or are going to a formal event? The answer is a tentative yes outside of small towns, but what are the details that lead them away from that perception? What, if anything, would remove all doubt?
For the record, I don't wear ties, and if I do go for this style, it will be tailored to death :)