Yes, even then. In general denim is just too casual for a tie.
Sometimes, just sometimes, I'll see someone in a summery outfit with a casual (knitted) tie and light jeans where the tie doesn't look out of place in a playful kind of way.
Just my opinion though.
There was some discussion on the matter on my native forum, should it interest you.