Depends on the office. I wear stuff like that every day. I've even worn orange pants.
It comes down to how formal the place is. Mine tends to be formal at times and informal at others. Kinda hard to explain but it works pretty well and if something I wear doesn't work at all, I can always change into scrubs for the day.