I doubt this would cause any major issues, so long as the upper and sole feel like they're tight together then I'd just go ahead and wear them. You might find that the stitching wears a little more quickly than expected if its not set in the sole properly but other then that should be fine.