Multiple gateway entries at istio config does not working as expected

I am testing https://istio.io/docs/setup/install/multicluster/shared-gateways/ with two clusters. Since i dont have a Load Balancer, i added all NodePort ips of Istio IngressGateway to the configmap’s network2 at the cluster1. But when i test with curl in a while loop, i got response from the Hello version that is deployed to cluster2, but when i close some nodes, i still see the request is going them. Any idea what the problem is?

network2:
endpoints:
- fromRegistry: n2-k8s-config
gateways:
- address: 10.35.72.228
port: 32268
- address: 10.35.72.230
port: 32268
- address: 10.35.72.231
port: 32268
- address: 10.35.72.232
port: 32268
- address: 10.35.72.238
port: 32268