It's all a matter of taste of course, but I reasoned like you when getting dressed this morning. Both the SC and pants are shades of brown, adding brown shoes would be monotonous, which works quite well if you go all blue or all grey. All brown is kinda tricky to pull of though.
Not feeling the brown loafers, but you might have a point about the buttoning point, it could be a cm lower or so.Edit. The length is also a bit shorter than I generally prefer, but it doesn't bother me. I want my jackets to at least cover the seat, which this one does (just barely though).