Disable or secure TCP load balancer installed by GKE add on

We are trying out the Istio GKE add on and were trying to figure out how to disable the creation of the TCP load balancer it creates or at least prevent public traffic to it. We are using a different mechanism to get external traffic to the istio-ingressgateway deployment. Is there any way to disable it?