FYI garden bloggers WP-super-cache brought my cpu usage down to 30% from 120% allowed on server. Hosting company much happier.
are there any downsides to the cache?
Not that I can tell, you can tweak the time limits to what ever works best on your site.