In Istio 1.5.1 , we are seeing what appears to be a very similar issue with istio ingressgateway memory usage linearly increasing ending in an OOM due to memory limit exceeded. The tcp connections seem to not grow with the memory. But envoy heap size seems to be increasing monotonously and never being reclaimed, eventhough the “allocated” memory shrinks down when connections to the gateway drop.
I am seeing a few different suggestions to address this:
- upgrade to istio 1.6 / 1.7
- configure envoy with
envoy.overload_actions.shrink_heapas suggested here
Could someone please advise / provide some guidance ?
I’ve also created an issue for this in istio GHE