This. A good relationship with an SA goes a long way. Even if you can't get the difference in cash, maybe you can get credit on a future purchase. The frays can be cleaned up, and the color is going to change with exposure to sunlight, so you might luck out and get it more even, but shell often has color variance. The rough texture is just the way the shell is sometimes, undesirable, but will not affect wearability.
Ultimately, as @Lobster33 said, you know the way you feel better than anyone. If its going to eat away at you, then don't keep. If you can live with them at an agreeable price, you have a shoe that could/should out live you.
Thanks guys. Sorry for the late response today was my birthday and I was out and about. I agree with you, I am going to use the SA next time. I need to find a good one! Do you have any favorite sales people or stores you normally shop at? I am going to send pics to the CAC and show them what they sent me. Let's see what they say. If they reduce the price I might keep them and take them to the shoe hospital to see if they can fix them. If not for $527 they are going back!