No, the scuffed sole won't be a problem. It will actually help to bond the rubber sole to the shoe by giving the leather more surface area and a rough surface to retain the glue used to install the half sole. And while I appreciate the modded sole, I still like the look of the leather sole the best! But with a less aggressive sole choice (Vibram 430?) they wouldn't look as "rough".