Guess I'm all alone on this one. While I don't overly mind the look on others, it's not a choice I would make for myself. A pocket square dresses up a jacket / suit to my eye. Doing so when you have chosen to dress down the oufit by omitting the tie and opening the collar seems like a bit of a mixed message to me.
Mixed messages are a beautiful, beautiful thing.