You could reduce the size of the pleat and that could possibly be a good compromise. I noticed today that your pleat is about 1/2" folded under on each side. In contrast my J Crew oxfords are roughly half that size at 1/4" folded under, this leads them to be more trim fitting in the back as the shirt doesn't flare open as much but visually changes very little. Just noticed so figured I would share.
Edited by Burzan - 9/1/16 at 9:40am