I implement on a big website varnish with django. And it is awesome!
The server with 6 cores have a lot of traffic even with memcached. The load average of the server is more than 3.6X withou varnish, with varnish the load down to 0.7x.
here the configuration, the plus is the admin it is available without problems.