Multi cluster mesh not working on 1.16

Multi cluster mesh was working just fine with istio 1.3.4.

But after the upgrade to 1.16 it stopped working. I even tried the helloworld sample given to verify the mesh config. But it is not working as expected.

The example i tried : Istio / Install Multi-Primary

But the response is not getting loadbalanced between 2 clusters. The response is always from 1 where im running the curl.

Expect the multicluster mesh, everything else is working fine.

Regards!

I have tested 1.16 and it works flawlessly. If you could shed some lights on the setup then I could possibly try to help you

Here are the IstioOperator yaml used to install latest istio.

apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
spec:
  values:
    global:
      meshID: mesh1
      multiCluster:
        clusterName: cluster1
      network: dev-subnetwork

apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
spec:
  values:
    global:
      meshID: mesh1
      multiCluster:
        clusterName: cluster2
      network: dev-subnetwork


The same helloworld.yaml and sleep.yaml were used as given in the example

Response from cluster1:
Hello version: v1, instance: helloworld-v1-776f57d5f6-kw92t
Hello version: v1, instance: helloworld-v1-776f57d5f6-kw92t
Hello version: v1, instance: helloworld-v1-776f57d5f6-kw92t
Hello version: v1, instance: helloworld-v1-776f57d5f6-kw92t

Response from cluster2:
Hello version: v2, instance: helloworld-v2-54df5f84b-9f4gz
Hello version: v2, instance: helloworld-v2-54df5f84b-9f4gz
Hello version: v2, instance: helloworld-v2-54df5f84b-9f4gz
Hello version: v2, instance: helloworld-v2-54df5f84b-9f4gz

Load balancing is not happening.

Please let me know what I am missing.

please can you share if it worked.