I think some of the museums are interesting in themselves because they are monuments of the Gilded Age. The Whitney was founded by a Vanderbilt daughter. The Moma was founded by Rockefeller Jr's wife.
If you are interested in going to a museum, consider taking the guided tour of the Frick Collection. They give you a tour of the fruits of the US Steel fortune - the beautiful Frick mansion and art.