Most supposedly slim khakis I try aren't particularly slim (then again I don't go above 100 buck either). Levi 511's are probably the best I've found. J. Crew is also there. H&M are actually skinny, the others still have a bit of room.
+1 on the 511's.