I think it depends on the cloth, but a fresco with relatively large weave wouldn't look like a suit jacket. The patch pockets also help, and perhaps also if the cloth had some kind of large-featured overpattern like a windowpane to help it look chunkier in texture. A pin- or chalkstripe may not be so good. Maybe toss in some conspicuous color-contrasted pick-stitching and super-pleated sleeve heads?
I'm not sure what you thought of my blue jacket, but I don't think it looks like an orphaned suit jacket because of the large weave and the patch pockets.