Istio service dashboard in grafana has no metrics

In one of our older istio installations(v1.1.8) the grafana istio service dashboard has no data. However few other dashboards do have data.

Grafana pod logs is filled with

2020/07/08 07:17:54 http: proxy error: context canceled
t=2020-07-08T07:17:54+0000 lvl=info msg=“Request Completed” logger=context userId=1 orgId=1 uname=admin method=GET path=/api/datasources/proxy/1/api/v1/query_range status=502 remote_addr=192.168.9.120 time_ms=1501 size=0 referer=https://example.com/d/LJ_uJAvmk/istio-service-dashboard

and telemetry pods logs

2020-07-08T09:50:36.017416Z error api Report failed: 1 error occurred:

  • failed to report all values: 4 errors occurred:
  • could not find metric info from adapter config for requestcount.instance.istio-system
  • could not find metric info from adapter config for requestduration.instance.istio-system
  • could not find metric info from adapter config for requestsize.instance.istio-system
  • could not find metric info from adapter config for responsesize.instance.istio-system