The vest, pocket square, and conservative shirt-tie combination make it look like a suit jacket. Without those, it wouldn't. (Also a factor is the illusion of solid gray.)
It probably is too formal to pair with most jeans, but you could try dark blue jeans with conservative-style brown shoes. If you have tan pants, they would work. Only black might be a problem, because of "rules" and shoes.