The sides would def be an issue.
Something I have noticed, I definitely find myself attracted to other brands for certain items. The blazers/ knits/pants i want are all pretty much Y with some exceptions (some cool EA stuff at the right price and the Y-3 collection recently). When it comes to shirts, I like Y, but I also like a lot of other designers equally. Especially for floral or prints (recently really liked duchamp's tonal floral patterned shirts).
That being said, still trying to figure out what my philosophy and approach to Y and clothing is.