The Latin Quarter is a good call for cheap eats. Also ...
Walk from the Louvre east along Rivoli to see a few decent high street style clothes and shoe shops.
Turn left on Rue St. Martin going towards the Pompidou Centre. There are several small pavement cafes there, and a late night ice cream shop too.