If I'm in wearing jeans, I wear a pair of Maine moccasins, made by Town View Leather.
If I'm in pajamas, I wear a pair of navy Derek Rose slippers
If I'm in wool trousers or chinos, I have two different pairs of house slippers by La Portegna - one with a studded rubber bottom, one just leather. I just put on which ever one I think looks best at the moment.
And for morning or evening showers, I have a pair of Brooks Brothers bath slippers.