Hummingbird is great in what it does BUT will not give you the performance you are after on its own. It NEEDS to be used with plugins like WP Super Cache or Litespeed Cache. Let me explain.
Hummingbird minifies, gzips, caches files in the browser (except fonts, which is a pain – I always add woff, ttf etc declarations to my htaccess manually) and lets you easily connect to cloudflare. It supports nginx, apache and litespeed. That’s great…
BUT…
it doesn’t do the most important part. The one that lets you save tons of your server resources – it doesn’t cache pages of your website as static files and later just serving them to browsers. That is why you REALLY need a plugin that does only that, like WP Super Cache or LiteSpeed Cache to get really, really good resuults (beating W3 Total Cache and even Fastest Cache).