Istio Ingress-Gateway Always Stale

Whenever I redeploy, the istio-ingressgateway is always in a stale state. I have not been able to successfully get ingress into a fully synced state. I am using the most up to date helm charts and am running v1.1.5 docker images. I am not sure how to get ingress into a fully ready state.

istio-ingressgateway-<uid>.istio-system SYNCED STALE (Never Acknowledged) SYNCED (100%) SYNCED istio-pilot-<uid> 1.1.3

I have ingress SDS enabled and sporadically I also encounter the error:
error SDS grpc server for ingress gateway proxy failed to start: accept unix /var/run/ingress_gateway/sds: use of closed network connection.

I have see a few issues opened that reference the closed network connection but I have not been able to identity this error in the Istio code?

1 Like

Iā€™m running k8s verision v1.13.6-gke.13 and istio 1.2.2

I saw a similar behaviour when i have a headless service called redis. I deleted the redis service and everything goes fine.

kubectl -n istio-system log -f istio-ingressgateway-765c6cbdf8-gl97w

ngressgateway-765c6cbdf8-gl97w.istio-system~istio-system.svc.cluster.local --max-obj-name-len 189 --local-address-ip-version v4 --allow-unknown-fields -l warning --component-log-level misc:error]                                           [2019-07-09 10:16:15.711][31][warning][main] [external/envoy/source/server/] shutting down admin due to child startup   
[2019-07-09 10:16:15.711][31][warning][main] [external/envoy/source/server/] terminating parent process                                                                                                                          [2019-07-09 10:16:15.734][114][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/_virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:86] gRPC config stream closed: 14, no healthy upstream
[2019-07-09 10:16:15.734][114][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/_virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:49] Unable to establish new stream
[2019-07-09 10:16:16.667][114][warning][config] [external/envoy/source/common/config/] gRPC config for rejected: Error adding/updating cluster(s) outbound|6379||my-r
elease-redis-headless.default.svc.cluster.local: cluster: cluster type 'original_dst' may only be used with LB type 'original_dst_lb```

Do you have Ingress SDS enabled?

No, SDS is disabled.