Caring for oil-tanned leather saddle shoes

[SEALBoy]

I have a pair of brown leather saddle shoes, and I was wondering what the best way to take care of their leather is. I know I shouldn't polish them. I know I'm supposed to use a mink oil conditioner to keep the leather soft and moisturized. However, these shoes are worn daily and naturally develop scuffs on the leather that are a lighter shade of brown. How can I remove these scuffs? Conditioner isn't useful because it is colorless. I tried using a color-matched Meltonian shoe cream everywhere on the shoe (kind of like a polish), but when I buffed it out the shoe felt slightly tacky and I didn't want to buff more to avoid polishing the leather.

Any tips on how to deal with the scuffs?