In my nyc apartment scenario, shoes come off pretty quick when I'm home, and I'm generally barefoot or in socks, unless its really cold in which case Ugg slippers.
If I was planning on going out again soon or had company, my shoes would stay on.
I find the "take of your shoes" rule annoying when I go to someone's house with that rule, discuss. At least in a less casual setting.
In bedrooms and stuff I would generally take shoes off. You kind of have to make a judgment on whether your shoes are dirty or clean.