Absolutely nothing's wrong, thats how AEs are. My guess is that they're designed that way to accommodate people with larger/fatter ankles; your ankles are normal/thin, therefore it'll look like theres excess material. Also, your low instep could be contributing to the problem. Just try on some other brands; I had the same prob with AEs, C&J dont give me the same problem