On my monitor, there just isn't enough contrast between the pants and shirt. IRL, I suspect the lavender vs. grey is much more pronounced. That said, I think a belt would create a sufficient visual break (I did see your comment that these pants are loopless).
White would definitely be more crisp with the light pants, especially sans belt.
Regardless, I'm picking nits on an overall solid look.