The size chart is correct. Your height / weight sounds like a medium, but it depends on what fit you are going for. The models on our site are 5'10" 160 & 6'2" 160 and both wear a medium, and the Kith TSP hoodies run the same.
There was a problem with Chrome which is being fixed, please try Safari.I'm not really sure how Naked & Famous fits. We do have size charts so I'd recommend using those. Generally people go down 1 size from their "normal" or "true" size in our washed denim.