It can, and probably often does, but I think shoulder slope, tie knot and width, and buttoning point all play a role in optimum collar height. They all seem to be a factor in creating the proper lines. A high buttoning point combined with a high collar might look a bit odd. Lower spread collars look better, at least on me, in a suit context, but I like higher spread (a recent development) with odd jackets.
If we are talking about non-spread collars with a low collar band, then yes, probably always sad.