I think it depends on what you "size down". Some people don't measure their real waist but their hips where the jeans sit. Then again a lot of Jeans run different. Diesel runs 1 - 2 sizes big, Levis runs small.
For APCs I think the perfect rule is to look at the thighs and the waist. It should feel tight in the beginning, but wearable.