Load Balancer Response time is more as compare to Elastic Search Latency

Question

We have an Elastic Search Cluster with 3 data nodes and 3 master nodes. We have exposed this Elastic Search with ELB in front of it.

Our Elastic Search Latency is 22-40 m