If you want to use Varnish with HTTPS there is a bad new. Varnish does not support HTTPS requests. In order to mitigate it, there are some typical configuration scenarios that you can try.
They consist of using a scenario where you have two web servers and varnish acting in between them. Our Magento stack has the part of this topology closer to the application. Then you need to set up a new server that handles HTTP and HTTPS request, it redirects the petitions via HTTP to varnish and the
classsic web server.
In order to understand better what I suggest there are some links detailing this solution: