The difference in a D width to an E width is 3/16ths of an inch. When sizing up in width the heel size also increases, for example a 9 B/D to a 9 C/E. This leaves you the possibility of the heel being too wide for you. From what you have said I would either go to a wider size or size up a 1/2 size to alleviate the width problem.
Why don't you fly to a retailer that knows what the fuck they're doing instead of asking a bunch of people on the internet what you should do? Alden in SF would be able to at least get you into a shoe one standard deviation from your true size.