The one thing I really don't cheap out on is food, mostly the staples. It's damm expensive but I'll make the effort to buy locally, organic if necessary and non-processed as much as possible.
This is a good point. Cheap staples sometimes jam up the stapler. The higher quality brands can also go through 2 or 3x the number of sheets of paper as the generics. Not to mention the easier unstapling (more generous malleability) if the need arises.