I guess you have rather thin heels.
Most asians have thin heels than most white men do.
I have a couple of sargents and I have the same problem. Not as much as you I persume but once my feet get swollen from a couple of walks, I barely notice it. They tend to run a bit large in the heels than other shoes such as CJ, Church's, etc