Dropbox Tech Blog has this in-depth article on "Optimizing web servers for high throughput and low latency". It goes over everything from hardware and low level operating system stuff all the way up to the application level. Great job, guys!