Virtual host based control of timeouts

Istio version : 1.12

Is there any way to apply the filter to a particular virtual host name ? I do not want to use the port number in the match.

apiVersion: networking.istio.io/v1alpha3
kind: EnvoyFilter
metadata:
  name: custom-http-timeouts
  namespace: tmtrflaavzwcnrf-y-or-x-002
spec:
  workloadSelector:
     labels:
       app: sleep
  configPatches:
  - applyTo: NETWORK_FILTER # http connection manager is a filter in Envoy
    match:
      context: SIDECAR_OUTBOUND
      listener:
        portNumber: 8000
        filterChain:
          filter:
            name: "envoy.filters.network.http_connection_manager"
    patch:
      operation: MERGE
      value:
        name: "envoy.filters.network.http_connection_manager"
        typed_config:
          "@type": "type.googleapis.com/envoy.extensions.filters.network.http_connection_manager.v3.HttpConnectionManager"
          stream_idle_timeout: 7s
          common_http_protocol_options:
            max_stream_duration: 7s