fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nodepool_active_versions.go:105]: failed to create node pool "np-1" for v20261001 cluster "v20261001"
Unexpected error:
    <*fmt.wrapError | 0x1b569c9d54e0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20261001" in resourcegroup="v20261001-mlcxj9z6srvl" to finish creating: GET https://rp.j6174848.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/5a974196-cc3e-4c19-83bb-20557d537e04
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/5a974196-cc3e-4c19-83bb-20557d537e04",
      "name": "5a974196-cc3e-4c19-83bb-20557d537e04",
      "status": "Failed",
      "startTime": "2026-10-12T00:41:24.479383887Z",
      "endTime": "2026-10-12T01:10:29.269134441Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j6174848.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/5a974196-cc3e-4c19-83bb-20557d537e04
            correlation ID: 2bffc39b-cd83-4954-a0a9-c7daa45e4979
            client request ID: 8e77b332-cff0-4849-90bf-1e7ad363de44
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nodepool_active_versions.go:105]: failed to create node pool "np-1" for v20261001 cluster "v20261001"
Unexpected error:
    <*fmt.wrapError | 0x1b569c9d54e0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20261001" in resourcegroup="v20261001-mlcxj9z6srvl" to finish creating: GET https://rp.j6174848.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/5a974196-cc3e-4c19-83bb-20557d537e04
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/5a974196-cc3e-4c19-83bb-20557d537e04",
      "name": "5a974196-cc3e-4c19-83bb-20557d537e04",
      "status": "Failed",
      "startTime": "2026-10-12T00:41:24.479383887Z",
      "endTime": "2026-10-12T01:10:29.269134441Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j6174848.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/5a974196-cc3e-4c19-83bb-20557d537e04
            correlation ID: 2bffc39b-cd83-4954-a0a9-c7daa45e4979
            client request ID: 8e77b332-cff0-4849-90bf-1e7ad363de44
occurred

alert fired 17 time(s) (14 unknown, 3 known)
Firing 1:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:04:40Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-lhgsl", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-lhgsl has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-tt7dl", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-tt7dl has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:03:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm576q05rv6mv1tq3kk25is17j9mp-d9q4e1z1g2p8n7i", pod="ignition-server-proxy-7f44d8d46-qdz9k", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm576q05rv6mv1tq3kk25is17j9mp-d9q4e1z1g2p8n7i/ignition-server-proxy-7f44d8d46-qdz9k has been in a non-ready state for longer than 5 minutes.
Firing 4:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-vp2rh", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-vp2rh has been in a non-ready state for longer than 5 minutes.
Firing 5:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="kube-controller-manager-6fbbbcbff9-8w5vs", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/kube-controller-manager-6fbbbcbff9-8w5vs has been in a non-ready state for longer than 5 minutes.
Firing 6:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-dfpqp", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-dfpqp has been in a non-ready state for longer than 5 minutes.
Firing 7:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:05:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm44q5ep2osnuu42ndqjo11p7p3m6-q6t1s1d8h2q6s5k", pod="ovnkube-control-plane-c5d7b9d44-sm4sw", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm44q5ep2osnuu42ndqjo11p7p3m6-q6t1s1d8h2q6s5k/ovnkube-control-plane-c5d7b9d44-sm4sw has been in a non-ready state for longer than 5 minutes.
Firing 8:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-5jm6z", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-5jm6z has been in a non-ready state for longer than 5 minutes.
Firing 9:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:04:39Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-hrjrj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-hrjrj has been in a non-ready state for longer than 5 minutes.
Firing 10:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:03:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm576q05rv6mv1tq3kk25is17j9mp-d9q4e1z1g2p8n7i", pod="ignition-server-proxy-7f44d8d46-8qzfv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm576q05rv6mv1tq3kk25is17j9mp-d9q4e1z1g2p8n7i/ignition-server-proxy-7f44d8d46-8qzfv has been in a non-ready state for longer than 5 minutes.
Firing 11:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:04:39Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-hp7l6", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-hp7l6 has been in a non-ready state for longer than 5 minutes.
Firing 12:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:04:40Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-jzrt5", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-jzrt5 has been in a non-ready state for longer than 5 minutes.
Firing 13:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas", pod="ignition-server-proxy-5988489558-lvr9j", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm2ma2es3e2pjmur7r5mim45j0fib-private-kas/ignition-server-proxy-5988489558-lvr9j has been in a non-ready state for longer than 5 minutes.
Firing 14:
  State:       Resolved
  Started:     2026-10-12T00:47:36Z
  Ended:       2026-10-12T01:08:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6174848-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctm3l4c9fvor23h7j8oq4g14n444ug-ingress-cert-le", pod="kube-controller-manager-bf5f57fb8-bdk2x", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tctm3l4c9fvor23h7j8oq4g14n444ug-ingress-cert-le/kube-controller-manager-bf5f57fb8-bdk2x has been in a non-ready state for longer than 5 minutes.

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-22-zhszcgnzg7zb/cluster-candidate-4-22-gwkf7b should provision
Unexpected error:
    <*fmt.wrapError | 0x17457dc5e0e0>: 
    failed to create HCP cluster cluster-candidate-4-22-gwkf7b: failed waiting for cluster="cluster-candidate-4-22-gwkf7b" in resourcegroup="rg-candidate-4-22-zhszcgnzg7zb" to finish creating: GET https://rp.j8959360.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425
    --------------------------------------------------------------------------------
    RESPONSE 404: 404 Not Found
    ERROR CODE: ResourceNotFound
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "ResourceNotFound",
        "message": "The resource 'locations/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425' under resource group '' was not found.",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j8959360.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425
            correlation ID: e870b595-733c-4e50-b159-c06646eb16ba
            client request ID: 7c347d72-8099-4796-893d-59762507c230
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-22-zhszcgnzg7zb/cluster-candidate-4-22-gwkf7b should provision
Unexpected error:
    <*fmt.wrapError | 0x17457dc5e0e0>: 
    failed to create HCP cluster cluster-candidate-4-22-gwkf7b: failed waiting for cluster="cluster-candidate-4-22-gwkf7b" in resourcegroup="rg-candidate-4-22-zhszcgnzg7zb" to finish creating: GET https://rp.j8959360.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425
    --------------------------------------------------------------------------------
    RESPONSE 404: 404 Not Found
    ERROR CODE: ResourceNotFound
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "ResourceNotFound",
        "message": "The resource 'locations/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425' under resource group '' was not found.",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j8959360.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/48785925-6e9d-4c48-aae6-599ebf8c4425
            correlation ID: e870b595-733c-4e50-b159-c06646eb16ba
            client request ID: 7c347d72-8099-4796-893d-59762507c230
occurred

alert fired 1 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-12T00:36:32Z
  Ended:       2026-10-12T00:41:46Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j8959360-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tctccghfgvuis1e4ubo7a7ap2uim0kd-w0e2c0f4m6k0z7f", pod="cluster-network-operator-67f4c84888-hzql4", region="centralus", severity="warning"
  Description: Pod ocm-arohcpci01-2tctccghfgvuis1e4ubo7a7ap2uim0kd-w0e2c0f4m6k0z7f/cluster-network-operator-67f4c84888-hzql4 has been in a non-ready state for longer than 5 minutes.

alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-11T23:00:46Z
  Severity:    Sev3
  Labels:      alertname="LeaderElectionLeaseStale", cluster="ci01-j3354496-mgmt-1", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.245:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3354496/providers/microsoft.monitor/accounts/services-j3354496", namespace="klusterlet-2tcrhmibf7k7vglj9iommmu4f595r7e7", pod="arohcp-monitor-kube-state-metrics-7988dc648c-jhnzl", prometheus="prometheus/prometheus", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Leader election lease work-manager in namespace klusterlet-2tcrhmibf7k7vglj9iommmu4f595r7e7 on cluster ci01-j3354496-mgmt-1 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running.

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:388]: Timed out after 600.006s.
Certificate should be issued by Let's Encrypt staging via ACME DNS-01
Expected success, but got an error:
    <*errors.errorString | 0x23a94d2a72e0>: 
    certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
    {
        s: "certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist",
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:388]: Timed out after 600.006s.
Certificate should be issued by Let's Encrypt staging via ACME DNS-01
Expected success, but got an error:
    <*errors.errorString | 0x23a94d2a72e0>: 
    certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
    {
        s: "certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist",
    }

alert fired 1 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-11T21:23:26Z
  Ended:       2026-10-11T21:29:27Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j6435200-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcqfah109q9u6g2h4huthue530shv73-p6r1u7s0v8h7i2h", pod="etcd-0", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcqfah109q9u6g2h4huthue530shv73-p6r1u7s0v8h7i2h/etcd-0 has been in a non-ready state for longer than 5 minutes.

alert fired 1 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-11T18:33:37Z
  Ended:       2026-10-11T18:42:37Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j8107776-svc", component="backend", name="actualhostedcluster", region="centralus", severity="warning"
  Description: Backend controller workqueue actualhostedcluster has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
    <*fmt.wrapError | 0x2952d6db0d20>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-ksddfkp5xbq5" to finish creating: GET https://rp.j8626176.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/6fd0636d-925f-45c9-a7fc-b6aa390b633a
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/6fd0636d-925f-45c9-a7fc-b6aa390b633a",
      "name": "6fd0636d-925f-45c9-a7fc-b6aa390b633a",
      "status": "Failed",
      "startTime": "2026-10-11T16:48:04.203625548Z",
      "endTime": "2026-10-11T17:17:06.363062447Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine v20260901-np-1-bkw9f-sxlv4: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-ksddfkp5xbq5--managed/providers/Microsoft.Compute/virtualMachines/v20260901-np-1-bkw9f-sxlv4 to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine v20260901-np-1-bkw9f-sxlv4: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-ksddfkp5xbq5--managed/providers/Microsoft.Compute/virtualMachines/v20260901-np-1-bkw9f-sxlv4 to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j8626176.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/6fd0636d-925f-45c9-a7fc-b6aa390b633a
            correlation ID: 9211dc6b-1604-468e-b90e-8381473929df
            client request ID: 967f10bc-a33e-4e81-877c-ed8ff3004e75
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
    <*fmt.wrapError | 0x2952d6db0d20>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-ksddfkp5xbq5" to finish creating: GET https://rp.j8626176.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/6fd0636d-925f-45c9-a7fc-b6aa390b633a
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/6fd0636d-925f-45c9-a7fc-b6aa390b633a",
      "name": "6fd0636d-925f-45c9-a7fc-b6aa390b633a",
      "status": "Failed",
      "startTime": "2026-10-11T16:48:04.203625548Z",
      "endTime": "2026-10-11T17:17:06.363062447Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine v20260901-np-1-bkw9f-sxlv4: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-ksddfkp5xbq5--managed/providers/Microsoft.Compute/virtualMachines/v20260901-np-1-bkw9f-sxlv4 to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine v20260901-np-1-bkw9f-sxlv4: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-ksddfkp5xbq5--managed/providers/Microsoft.Compute/virtualMachines/v20260901-np-1-bkw9f-sxlv4 to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j8626176.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/6fd0636d-925f-45c9-a7fc-b6aa390b633a
            correlation ID: 9211dc6b-1604-468e-b90e-8381473929df
            client request ID: 967f10bc-a33e-4e81-877c-ed8ff3004e75
occurred

alert fired 1 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-11T15:52:40Z
  Ended:       2026-10-11T16:12:42Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j1984128-svc", component="backend", name="actualhostedcluster", region="centralus", severity="warning"
  Description: Backend controller workqueue actualhostedcluster has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:137]: failed to create node pool
Expected success, but got an error:
    <*fmt.wrapError | 0xe1c86824ac0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "ingress-cert-le" in resourcegroup="ingress-cert-le-cnc5f6qgdgz8" to finish creating: GET https://rp.j5701760.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/58fb2269-9049-4fd2-9274-ac2190a19932
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/58fb2269-9049-4fd2-9274-ac2190a19932",
      "name": "58fb2269-9049-4fd2-9274-ac2190a19932",
      "status": "Failed",
      "startTime": "2026-10-11T12:57:29.816928878Z",
      "endTime": "2026-10-11T13:26:38.515811706Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine ingress-cert-le-np-1-xr7ss-282dw: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-cnc5f6qgdgz8--managed/providers/Microsoft.Compute/virtualMachines/ingress-cert-le-np-1-xr7ss-282dw to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine ingress-cert-le-np-1-xr7ss-282dw: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-cnc5f6qgdgz8--managed/providers/Microsoft.Compute/virtualMachines/ingress-cert-le-np-1-xr7ss-282dw to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j5701760.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/58fb2269-9049-4fd2-9274-ac2190a19932
            correlation ID: b9b2478c-6a44-4ebb-ade0-4de59279ccb4
            client request ID: 4eee6950-aeb4-430b-b956-66f798ff6c28
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:137]: failed to create node pool
Expected success, but got an error:
    <*fmt.wrapError | 0xe1c86824ac0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "ingress-cert-le" in resourcegroup="ingress-cert-le-cnc5f6qgdgz8" to finish creating: GET https://rp.j5701760.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/58fb2269-9049-4fd2-9274-ac2190a19932
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/58fb2269-9049-4fd2-9274-ac2190a19932",
      "name": "58fb2269-9049-4fd2-9274-ac2190a19932",
      "status": "Failed",
      "startTime": "2026-10-11T12:57:29.816928878Z",
      "endTime": "2026-10-11T13:26:38.515811706Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine ingress-cert-le-np-1-xr7ss-282dw: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-cnc5f6qgdgz8--managed/providers/Microsoft.Compute/virtualMachines/ingress-cert-le-np-1-xr7ss-282dw to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine ingress-cert-le-np-1-xr7ss-282dw: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-cnc5f6qgdgz8--managed/providers/Microsoft.Compute/virtualMachines/ingress-cert-le-np-1-xr7ss-282dw to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://rp.j5701760.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/centralus/hcpOperationStatuses/58fb2269-9049-4fd2-9274-ac2190a19932
            correlation ID: b9b2478c-6a44-4ebb-ade0-4de59279ccb4
            client request ID: 4eee6950-aeb4-430b-b956-66f798ff6c28

alert fired 119 time(s) (91 unknown, 28 known)
Firing 1:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-s44bv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-s44bv has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-tspd2", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-tspd2 has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-ztqvn", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-ztqvn has been in a non-ready state for longer than 5 minutes.
Firing 4:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-pp7zn", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-pp7zn has been in a non-ready state for longer than 5 minutes.
Firing 5:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-r72lv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-r72lv has been in a non-ready state for longer than 5 minutes.
Firing 6:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-nqrl7", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-nqrl7 has been in a non-ready state for longer than 5 minutes.
Firing 7:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-sx6j8", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-sx6j8 has been in a non-ready state for longer than 5 minutes.
Firing 8:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-vlbv7", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-vlbv7 has been in a non-ready state for longer than 5 minutes.
Firing 9:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-hjrmd", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-hjrmd has been in a non-ready state for longer than 5 minutes.
Firing 10:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-p4d2c", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-p4d2c has been in a non-ready state for longer than 5 minutes.
Firing 11:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-59nvf", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-59nvf has been in a non-ready state for longer than 5 minutes.
Firing 12:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-p7kmj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-p7kmj has been in a non-ready state for longer than 5 minutes.
Firing 13:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="control-plane-operator-5d494df9db-kr48l", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/control-plane-operator-5d494df9db-kr48l has been in a non-ready state for longer than 5 minutes.
Firing 14:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-xp74t", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-xp74t has been in a non-ready state for longer than 5 minutes.
Firing 15:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-knbx9", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-knbx9 has been in a non-ready state for longer than 5 minutes.
Firing 16:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-5kklq", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-5kklq has been in a non-ready state for longer than 5 minutes.
Firing 17:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:03:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-vqpjv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-vqpjv has been in a non-ready state for longer than 5 minutes.
Firing 18:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-764cz", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-764cz has been in a non-ready state for longer than 5 minutes.
Firing 19:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-c2hxl", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-c2hxl has been in a non-ready state for longer than 5 minutes.
Firing 20:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-k7cqj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-k7cqj has been in a non-ready state for longer than 5 minutes.
Firing 21:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-fkpms", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-fkpms has been in a non-ready state for longer than 5 minutes.
Firing 22:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-qkvcs", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-qkvcs has been in a non-ready state for longer than 5 minutes.
Firing 23:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-5jxf6", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-5jxf6 has been in a non-ready state for longer than 5 minutes.
Firing 24:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-dz5nh", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-dz5nh has been in a non-ready state for longer than 5 minutes.
Firing 25:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-ktmkd", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-ktmkd has been in a non-ready state for longer than 5 minutes.
Firing 26:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-c2lp7", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-c2lp7 has been in a non-ready state for longer than 5 minutes.
Firing 27:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-g6bw4", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-g6bw4 has been in a non-ready state for longer than 5 minutes.
Firing 28:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-999w8", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-999w8 has been in a non-ready state for longer than 5 minutes.
Firing 29:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-qxvsl", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-qxvsl has been in a non-ready state for longer than 5 minutes.
Firing 30:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-dln2j", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-dln2j has been in a non-ready state for longer than 5 minutes.
Firing 31:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-v8flq", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-v8flq has been in a non-ready state for longer than 5 minutes.
Firing 32:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-7r6qc", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-7r6qc has been in a non-ready state for longer than 5 minutes.
Firing 33:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-lj7wd", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-lj7wd has been in a non-ready state for longer than 5 minutes.
Firing 34:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:03:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-vwd26", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-vwd26 has been in a non-ready state for longer than 5 minutes.
Firing 35:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-ph8gv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-ph8gv has been in a non-ready state for longer than 5 minutes.
Firing 36:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-kh5zr", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-kh5zr has been in a non-ready state for longer than 5 minutes.
Firing 37:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-6r5ln", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-6r5ln has been in a non-ready state for longer than 5 minutes.
Firing 38:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-xrh2q", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-xrh2q has been in a non-ready state for longer than 5 minutes.
Firing 39:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-rmgkv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-rmgkv has been in a non-ready state for longer than 5 minutes.
Firing 40:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-4bd5r", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-4bd5r has been in a non-ready state for longer than 5 minutes.
Firing 41:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-ztg86", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-ztg86 has been in a non-ready state for longer than 5 minutes.
Firing 42:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-4twsj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-4twsj has been in a non-ready state for longer than 5 minutes.
Firing 43:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-bpf5r", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-bpf5r has been in a non-ready state for longer than 5 minutes.
Firing 44:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-wgc2x", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-wgc2x has been in a non-ready state for longer than 5 minutes.
Firing 45:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-cdkhc", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-cdkhc has been in a non-ready state for longer than 5 minutes.
Firing 46:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-vgll5", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-vgll5 has been in a non-ready state for longer than 5 minutes.
Firing 47:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-ln4zj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-ln4zj has been in a non-ready state for longer than 5 minutes.
Firing 48:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-7v5qb", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-7v5qb has been in a non-ready state for longer than 5 minutes.
Firing 49:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-4q9wz", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-4q9wz has been in a non-ready state for longer than 5 minutes.
Firing 50:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-rxd9d", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-rxd9d has been in a non-ready state for longer than 5 minutes.
Firing 51:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-6mwn2", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-6mwn2 has been in a non-ready state for longer than 5 minutes.
Firing 52:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-247jg", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-247jg has been in a non-ready state for longer than 5 minutes.
Firing 53:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="control-plane-operator-5d494df9db-nl4zs", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/control-plane-operator-5d494df9db-nl4zs has been in a non-ready state for longer than 5 minutes.
Firing 54:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-fw9c4", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-fw9c4 has been in a non-ready state for longer than 5 minutes.
Firing 55:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-lfq89", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-lfq89 has been in a non-ready state for longer than 5 minutes.
Firing 56:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-v4jn2", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-v4jn2 has been in a non-ready state for longer than 5 minutes.
Firing 57:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-kv5s2", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-kv5s2 has been in a non-ready state for longer than 5 minutes.
Firing 58:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-ddfxc", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-ddfxc has been in a non-ready state for longer than 5 minutes.
Firing 59:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-blff2", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-blff2 has been in a non-ready state for longer than 5 minutes.
Firing 60:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-jffgt", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-jffgt has been in a non-ready state for longer than 5 minutes.
Firing 61:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-mpgpp", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-mpgpp has been in a non-ready state for longer than 5 minutes.
Firing 62:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-wh54t", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-wh54t has been in a non-ready state for longer than 5 minutes.
Firing 63:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-bv7qc", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-bv7qc has been in a non-ready state for longer than 5 minutes.
Firing 64:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-2xgbl", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-2xgbl has been in a non-ready state for longer than 5 minutes.
Firing 65:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-8bvfh", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-8bvfh has been in a non-ready state for longer than 5 minutes.
Firing 66:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-lmvqp", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-lmvqp has been in a non-ready state for longer than 5 minutes.
Firing 67:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-czzdk", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-czzdk has been in a non-ready state for longer than 5 minutes.
Firing 68:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-8lkjj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-8lkjj has been in a non-ready state for longer than 5 minutes.
Firing 69:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-ww4c7", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-ww4c7 has been in a non-ready state for longer than 5 minutes.
Firing 70:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-qrpjz", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-qrpjz has been in a non-ready state for longer than 5 minutes.
Firing 71:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-568rf", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-568rf has been in a non-ready state for longer than 5 minutes.
Firing 72:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-jt8qn", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-jt8qn has been in a non-ready state for longer than 5 minutes.
Firing 73:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-5tr5d", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-5tr5d has been in a non-ready state for longer than 5 minutes.
Firing 74:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-cpkmb", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-cpkmb has been in a non-ready state for longer than 5 minutes.
Firing 75:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-7ctwg", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-7ctwg has been in a non-ready state for longer than 5 minutes.
Firing 76:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-sb8km", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-sb8km has been in a non-ready state for longer than 5 minutes.
Firing 77:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-njj8b", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-njj8b has been in a non-ready state for longer than 5 minutes.
Firing 78:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-s57sq", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-s57sq has been in a non-ready state for longer than 5 minutes.
Firing 79:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:29Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-svt9x", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-svt9x has been in a non-ready state for longer than 5 minutes.
Firing 80:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:01:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-fngz6", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-fngz6 has been in a non-ready state for longer than 5 minutes.
Firing 81:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-7grwx", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-7grwx has been in a non-ready state for longer than 5 minutes.
Firing 82:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-z56x9", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-z56x9 has been in a non-ready state for longer than 5 minutes.
Firing 83:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-ph8p9", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-ph8p9 has been in a non-ready state for longer than 5 minutes.
Firing 84:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-nplt8", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-nplt8 has been in a non-ready state for longer than 5 minutes.
Firing 85:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:33Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-ht56m", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-ht56m has been in a non-ready state for longer than 5 minutes.
Firing 86:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-766ms", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-766ms has been in a non-ready state for longer than 5 minutes.
Firing 87:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:02:34Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-bmp96", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-bmp96 has been in a non-ready state for longer than 5 minutes.
Firing 88:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:03:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a", pod="cluster-api-758886dcdd-tdcb8", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdt5p5krgk8c9s2qa52muf0s2leo-o5c6e9o7o9u8u2a/cluster-api-758886dcdd-tdcb8 has been in a non-ready state for longer than 5 minutes.
Firing 89:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T06:06:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q", pod="ovnkube-control-plane-84746c8bb7-7k2zp", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctg51ab7lhn1327cqn1ro610k7o09-g7m4x8h2o0n2u0q/ovnkube-control-plane-84746c8bb7-7k2zp has been in a non-ready state for longer than 5 minutes.
Firing 90:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:57:31Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p", pod="network-node-identity-699479db79-hc79n", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcctdihs6bopliddcb2r3r2grv2jd6r-f0j1t3p3q3h3e5p/network-node-identity-699479db79-hc79n has been in a non-ready state for longer than 5 minutes.
Firing 91:
  State:       Resolved
  Started:     2026-10-11T05:38:35Z
  Ended:       2026-10-11T05:56:30Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9177088-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s", pod="kube-controller-manager-7d88d8ddc6-wdfkq", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2tcct8i6p9rmb6p0qtjmra4rleu9p1p6-y7r8u9b9d9y6s8s/kube-controller-manager-7d88d8ddc6-wdfkq has been in a non-ready state for longer than 5 minutes.

fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:137]: failed to verify basic cluster health for idms-e2e-hcp-cluster
Unexpected error:
    <*errors.joinError | 0x19c6c82ad0e0>: 
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized
    VerifyBasicAccess failed: failed to list services: Unauthorized
    {
        errs: [
            <*fmt.wrapError | 0x19c6c78ffea0>{
                msg: "VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized",
                err: <*fmt.wrapError | 0x19c6c78ffe80>{
                    msg: "failed to list all APIServices: Unauthorized",
                    err: <*errors.StatusError | 0x19c6c7ea8960>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
            <*fmt.wrapError | 0x19c6c8695740>{
                msg: "VerifyBasicAccess failed: failed to list services: Unauthorized",
                err: <*fmt.wrapError | 0x19c6c8695720>{
                    msg: "failed to list services: Unauthorized",
                    err: <*errors.StatusError | 0x19c6c7b65c20>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:137]: failed to verify basic cluster health for idms-e2e-hcp-cluster
Unexpected error:
    <*errors.joinError | 0x19c6c82ad0e0>: 
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized
    VerifyBasicAccess failed: failed to list services: Unauthorized
    {
        errs: [
            <*fmt.wrapError | 0x19c6c78ffea0>{
                msg: "VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized",
                err: <*fmt.wrapError | 0x19c6c78ffe80>{
                    msg: "failed to list all APIServices: Unauthorized",
                    err: <*errors.StatusError | 0x19c6c7ea8960>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
            <*fmt.wrapError | 0x19c6c8695740>{
                msg: "VerifyBasicAccess failed: failed to list services: Unauthorized",
                err: <*fmt.wrapError | 0x19c6c8695720>{
                    msg: "failed to list services: Unauthorized",
                    err: <*errors.StatusError | 0x19c6c7b65c20>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:193]: failed to update HCP cluster tags via PATCH
Unexpected error:
    <*exported.ResponseError | 0x2478de214db0>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-9589trzrcm22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-9589trzrcm22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
            correlation ID: 1985dc52-0e75-413c-9ede-87cb3e6ad675
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:193]: failed to update HCP cluster tags via PATCH
Unexpected error:
    <*exported.ResponseError | 0x2478de214db0>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-9589trzrcm22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-9589trzrcm22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
            correlation ID: 1985dc52-0e75-413c-9ede-87cb3e6ad675
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:275]: failed to begin cluster "agg-cluster" authorized CIDR update
Unexpected error:
    <*exported.ResponseError | 0x2482f98dd8f0>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-kgfhn26xlnc9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-kgfhn26xlnc9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
            correlation ID: 6cddad86-b2cb-402b-b9c5-2d33d805daed
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:275]: failed to begin cluster "agg-cluster" authorized CIDR update
Unexpected error:
    <*exported.ResponseError | 0x2482f98dd8f0>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-kgfhn26xlnc9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-kgfhn26xlnc9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
            correlation ID: 6cddad86-b2cb-402b-b9c5-2d33d805daed
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:408]: failed to begin updating cluster "cidr-connectivity-test" authorized CIDRs
Unexpected error:
    <*exported.ResponseError | 0x1fc144a8a360>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-48s6s8v68r22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-48s6s8v68r22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
            correlation ID: 308b2783-d950-49dc-bba1-b7f5095895de
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:408]: failed to begin updating cluster "cidr-connectivity-test" authorized CIDRs
Unexpected error:
    <*exported.ResponseError | 0x1fc144a8a360>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-48s6s8v68r22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-48s6s8v68r22/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
            correlation ID: 308b2783-d950-49dc-bba1-b7f5095895de
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:254]: cluster oidc-wi-cluster is not viable
Unexpected error:
    <*errors.joinError | 0x11944cc8930>: 
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized
    VerifyBasicAccess failed: failed to list services: Unauthorized
    {
        errs: [
            <*fmt.wrapError | 0x11944de5c00>{
                msg: "VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized",
                err: <*fmt.wrapError | 0x11944de5be0>{
                    msg: "failed to list all APIServices: Unauthorized",
                    err: <*errors.StatusError | 0x11945431e00>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
            <*fmt.wrapError | 0x11944978520>{
                msg: "VerifyBasicAccess failed: failed to list services: Unauthorized",
                err: <*fmt.wrapError | 0x11944978500>{
                    msg: "failed to list services: Unauthorized",
                    err: <*errors.StatusError | 0x11944c97ae0>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:254]: cluster oidc-wi-cluster is not viable
Unexpected error:
    <*errors.joinError | 0x11944cc8930>: 
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized
    VerifyBasicAccess failed: failed to list services: Unauthorized
    {
        errs: [
            <*fmt.wrapError | 0x11944de5c00>{
                msg: "VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Unauthorized",
                err: <*fmt.wrapError | 0x11944de5be0>{
                    msg: "failed to list all APIServices: Unauthorized",
                    err: <*errors.StatusError | 0x11945431e00>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
            <*fmt.wrapError | 0x11944978520>{
                msg: "VerifyBasicAccess failed: failed to list services: Unauthorized",
                err: <*fmt.wrapError | 0x11944978500>{
                    msg: "failed to list services: Unauthorized",
                    err: <*errors.StatusError | 0x11944c97ae0>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                                ShardInfo: nil,
                            },
                            Status: "Failure",
                            Message: "Unauthorized",
                            Reason: "Unauthorized",
                            Details: nil,
                            Code: 401,
                        },
                    },
                },
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:173]: failed to update cluster "autoscaling-hcp-cluster" autoscaling configuration
Unexpected error:
    <*exported.ResponseError | 0x1809749e4ab0>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-bt79q5smg9ln/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-bt79q5smg9ln/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
            correlation ID: 169674f2-a45c-486a-9ed8-ef274e1803f2
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:173]: failed to update cluster "autoscaling-hcp-cluster" autoscaling configuration
Unexpected error:
    <*exported.ResponseError | 0x1809749e4ab0>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-bt79q5smg9ln/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-bt79q5smg9ln/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
            correlation ID: 169674f2-a45c-486a-9ed8-ef274e1803f2
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x5325624e738>: 
    resource group "cni-cilium-g76pf6t9h842": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cilium-cl" in resourcegroup="cni-cilium-g76pf6t9h842" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/179cc551-21d3-4583-b554-f672e37b3a84
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/179cc551-21d3-4583-b554-f672e37b3a84",
      "name": "179cc551-21d3-4583-b554-f672e37b3a84",
      "status": "Failed",
      "startTime": "2026-10-11T22:50:53.504973281Z",
      "endTime": "2026-10-11T23:14:57.954117538Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2tcruuiers9mtsh6kof4evdrtdk9p3e4 still exists (deletion dispatched at 2026-10-11T22:50:54Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/serviceProviderClusters, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x5325624e738>: 
    resource group "cni-cilium-g76pf6t9h842": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cilium-cl" in resourcegroup="cni-cilium-g76pf6t9h842" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/179cc551-21d3-4583-b554-f672e37b3a84
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/179cc551-21d3-4583-b554-f672e37b3a84",
      "name": "179cc551-21d3-4583-b554-f672e37b3a84",
      "status": "Failed",
      "startTime": "2026-10-11T22:50:53.504973281Z",
      "endTime": "2026-10-11T23:14:57.954117538Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2tcruuiers9mtsh6kof4evdrtdk9p3e4 still exists (deletion dispatched at 2026-10-11T22:50:54Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/serviceProviderClusters, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0x1003aae08080>: 
    failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-dvn947jdn4hc" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/3c051cc9-3f87-43a3-86ce-d9c6d0efccb9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/3c051cc9-3f87-43a3-86ce-d9c6d0efccb9",
      "name": "3c051cc9-3f87-43a3-86ce-d9c6d0efccb9",
      "status": "Failed",
      "startTime": "2026-10-11T23:48:35.970441715Z",
      "endTime": "2026-10-12T00:17:41.715765376Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-dvn947jdn4hc--managed/providers/Microsoft.Compute/virtualMachines/q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-dvn947jdn4hc--managed/providers/Microsoft.Compute/virtualMachines/q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/3c051cc9-3f87-43a3-86ce-d9c6d0efccb9
            correlation ID: e2102b28-bcd5-415f-bde1-1dd34ba167b4
            client request ID: unavailable
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0x1003aae08080>: 
    failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-dvn947jdn4hc" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/3c051cc9-3f87-43a3-86ce-d9c6d0efccb9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/3c051cc9-3f87-43a3-86ce-d9c6d0efccb9",
      "name": "3c051cc9-3f87-43a3-86ce-d9c6d0efccb9",
      "status": "Failed",
      "startTime": "2026-10-11T23:48:35.970441715Z",
      "endTime": "2026-10-12T00:17:41.715765376Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-dvn947jdn4hc--managed/providers/Microsoft.Compute/virtualMachines/q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-dvn947jdn4hc--managed/providers/Microsoft.Compute/virtualMachines/q7p0f9j6y7m4m7c-np-deletable-glcrn-8z7zf to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/3c051cc9-3f87-43a3-86ce-d9c6d0efccb9
            correlation ID: e2102b28-bcd5-415f-bde1-1dd34ba167b4
            client request ID: unavailable

fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:175]: failed to update cluster with second ImageDigestMirror set
Unexpected error:
    <*exported.ResponseError | 0x3cb7f249e30>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-bwnjnsrh77xp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-bwnjnsrh77xp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster
            correlation ID: 326b9417-df61-4372-bd77-c007393853e2
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:175]: failed to update cluster with second ImageDigestMirror set
Unexpected error:
    <*exported.ResponseError | 0x3cb7f249e30>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-bwnjnsrh77xp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-bwnjnsrh77xp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster
            correlation ID: 326b9417-df61-4372-bd77-c007393853e2
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:408]: failed to begin updating cluster "cidr-connectivity-test" authorized CIDRs
Unexpected error:
    <*exported.ResponseError | 0x651b1589410>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-gx6bw8krnxdc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-gx6bw8krnxdc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
            correlation ID: 8266feca-7a35-4c9d-b5da-450588c39766
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:408]: failed to begin updating cluster "cidr-connectivity-test" authorized CIDRs
Unexpected error:
    <*exported.ResponseError | 0x651b1589410>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-gx6bw8krnxdc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-gx6bw8krnxdc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
            correlation ID: 8266feca-7a35-4c9d-b5da-450588c39766
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-0-phmgklt4jbx8/cluster-nightly-5-0-dsvpsx should provision
Unexpected error:
    <*fmt.wrapError | 0x174e773b4b40>: 
    failed to create HCP cluster cluster-nightly-5-0-dsvpsx: failed waiting for cluster="cluster-nightly-5-0-dsvpsx" in resourcegroup="rg-nightly-5-0-phmgklt4jbx8" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1dcda58e-002a-4f82-9591-34d179e38dd7
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1dcda58e-002a-4f82-9591-34d179e38dd7",
      "name": "1dcda58e-002a-4f82-9591-34d179e38dd7",
      "status": "Failed",
      "startTime": "2026-10-11T23:24:10.263042602Z",
      "endTime": "2026-10-11T23:53:11.680283328Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: ComponentsNotAvailable: Waiting for components to be available: cluster-network-operator, azure-cloud-controller-manager, catalog-operator, openshift-route-controller-manager, hosted-cluster-config-operator, olm-operator, openshift-controller-manager, cluster-policy-controller, kube-controller-manager, cluster-node-tuning-operator, dns-operator, csi-snapshot-controller-operator, community-operators-catalog, cluster-storage-operator, konnectivity-agent, cluster-image-registry-operator, cluster-version-operator, ingress-operator, packageserver, redhat-operators-catalog, certified-operators-catalog, machine-approver; hosted cluster degraded: UnavailableReplicas: [azure-cloud-controller-manager deployment has 1 unavailable replicas, catalog-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, konnectivity-agent deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas, machine-approver deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, openshift-apiserver deployment has 1 unavailable replicas, packageserver deployment has 3 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1dcda58e-002a-4f82-9591-34d179e38dd7
            correlation ID: 8da2e5e4-c1bb-4598-8408-0edb1c690ef8
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-0-phmgklt4jbx8/cluster-nightly-5-0-dsvpsx should provision
Unexpected error:
    <*fmt.wrapError | 0x174e773b4b40>: 
    failed to create HCP cluster cluster-nightly-5-0-dsvpsx: failed waiting for cluster="cluster-nightly-5-0-dsvpsx" in resourcegroup="rg-nightly-5-0-phmgklt4jbx8" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1dcda58e-002a-4f82-9591-34d179e38dd7
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1dcda58e-002a-4f82-9591-34d179e38dd7",
      "name": "1dcda58e-002a-4f82-9591-34d179e38dd7",
      "status": "Failed",
      "startTime": "2026-10-11T23:24:10.263042602Z",
      "endTime": "2026-10-11T23:53:11.680283328Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: ComponentsNotAvailable: Waiting for components to be available: cluster-network-operator, azure-cloud-controller-manager, catalog-operator, openshift-route-controller-manager, hosted-cluster-config-operator, olm-operator, openshift-controller-manager, cluster-policy-controller, kube-controller-manager, cluster-node-tuning-operator, dns-operator, csi-snapshot-controller-operator, community-operators-catalog, cluster-storage-operator, konnectivity-agent, cluster-image-registry-operator, cluster-version-operator, ingress-operator, packageserver, redhat-operators-catalog, certified-operators-catalog, machine-approver; hosted cluster degraded: UnavailableReplicas: [azure-cloud-controller-manager deployment has 1 unavailable replicas, catalog-operator deployment has 1 unavailable replicas, hosted-cluster-config-operator deployment has 1 unavailable replicas, konnectivity-agent deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas, machine-approver deployment has 1 unavailable replicas, olm-operator deployment has 1 unavailable replicas, openshift-apiserver deployment has 1 unavailable replicas, packageserver deployment has 3 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1dcda58e-002a-4f82-9591-34d179e38dd7
            correlation ID: 8da2e5e4-c1bb-4598-8408-0edb1c690ef8
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:193]: failed to update HCP cluster tags via PATCH
Unexpected error:
    <*exported.ResponseError | 0x2b2d2ab80c30>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-99dhh5lb5zrf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-99dhh5lb5zrf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
            correlation ID: 6a1cddf9-69d2-480e-9369-0bdf2d5fafea
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:193]: failed to update HCP cluster tags via PATCH
Unexpected error:
    <*exported.ResponseError | 0x2b2d2ab80c30>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-99dhh5lb5zrf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-99dhh5lb5zrf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
            correlation ID: 6a1cddf9-69d2-480e-9369-0bdf2d5fafea
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:275]: failed to begin cluster "agg-cluster" authorized CIDR update
Unexpected error:
    <*exported.ResponseError | 0x23c69c127620>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-6bqc7wxnpls2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-6bqc7wxnpls2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
            correlation ID: 8c15b69a-1a45-4b77-97f7-cc3c4f7303d9
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:275]: failed to begin cluster "agg-cluster" authorized CIDR update
Unexpected error:
    <*exported.ResponseError | 0x23c69c127620>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-6bqc7wxnpls2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-6bqc7wxnpls2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster
            correlation ID: 8c15b69a-1a45-4b77-97f7-cc3c4f7303d9
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:173]: failed to update cluster "autoscaling-hcp-cluster" autoscaling configuration
Unexpected error:
    <*exported.ResponseError | 0x3a9f56439c50>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-nhdf6nnvkxfl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-nhdf6nnvkxfl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
            correlation ID: 9de7ea40-32be-4320-949c-45a19d8c9f2a
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:173]: failed to update cluster "autoscaling-hcp-cluster" autoscaling configuration
Unexpected error:
    <*exported.ResponseError | 0x3a9f56439c50>: 
    PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-nhdf6nnvkxfl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.21\": must be specified as MAJOR.MINOR.PATCH (optionally with a pre-release, e.g. a nightly build suffix) when channelGroup is \"nightly\"",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-nhdf6nnvkxfl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster
            correlation ID: 9de7ea40-32be-4320-949c-45a19d8c9f2a
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-1-nb9jxpzlfmcp/cluster-nightly-5-1-wkbflh should provision
Unexpected error:
    <*fmt.wrapError | 0x1d0dfed5cd40>: 
    failed to create HCP cluster cluster-nightly-5-1-wkbflh: failed waiting for cluster="cluster-nightly-5-1-wkbflh" in resourcegroup="rg-nightly-5-1-nb9jxpzlfmcp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/e4b00e07-8ca7-4a34-a5ca-40ac469ad96a
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/e4b00e07-8ca7-4a34-a5ca-40ac469ad96a",
      "name": "e4b00e07-8ca7-4a34-a5ca-40ac469ad96a",
      "status": "Failed",
      "startTime": "2026-10-11T23:24:11.419225738Z",
      "endTime": "2026-10-11T23:53:12.203667325Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 5.1.0-0.nightly-multi-2026-09-30-181926 is Partial (want Completed), started 22m49s ago; hosted cluster degraded: UnavailableReplicas: [hosted-cluster-config-operator deployment has 1 unavailable replicas, ignition-server-proxy deployment has 1 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/e4b00e07-8ca7-4a34-a5ca-40ac469ad96a
            correlation ID: b50e9c9e-d4f4-4ba1-9e2c-863be02b98b4
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-1-nb9jxpzlfmcp/cluster-nightly-5-1-wkbflh should provision
Unexpected error:
    <*fmt.wrapError | 0x1d0dfed5cd40>: 
    failed to create HCP cluster cluster-nightly-5-1-wkbflh: failed waiting for cluster="cluster-nightly-5-1-wkbflh" in resourcegroup="rg-nightly-5-1-nb9jxpzlfmcp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/e4b00e07-8ca7-4a34-a5ca-40ac469ad96a
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/e4b00e07-8ca7-4a34-a5ca-40ac469ad96a",
      "name": "e4b00e07-8ca7-4a34-a5ca-40ac469ad96a",
      "status": "Failed",
      "startTime": "2026-10-11T23:24:11.419225738Z",
      "endTime": "2026-10-11T23:53:12.203667325Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 5.1.0-0.nightly-multi-2026-09-30-181926 is Partial (want Completed), started 22m49s ago; hosted cluster degraded: UnavailableReplicas: [hosted-cluster-config-operator deployment has 1 unavailable replicas, ignition-server-proxy deployment has 1 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/e4b00e07-8ca7-4a34-a5ca-40ac469ad96a
            correlation ID: b50e9c9e-d4f4-4ba1-9e2c-863be02b98b4
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-20-nnnfjhqw4q7g/cluster-nightly-4-20-4mtrqs should provision
Unexpected error:
    <*fmt.wrapError | 0x1e45881b1020>: 
    failed to create HCP cluster cluster-nightly-4-20-4mtrqs: failed waiting for cluster="cluster-nightly-4-20-4mtrqs" in resourcegroup="rg-nightly-4-20-nnnfjhqw4q7g" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/20d3ef3a-5603-49e7-a89b-176457ccafcd
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/20d3ef3a-5603-49e7-a89b-176457ccafcd",
      "name": "20d3ef3a-5603-49e7-a89b-176457ccafcd",
      "status": "Failed",
      "startTime": "2026-10-11T23:20:27.297702896Z",
      "endTime": "2026-10-11T23:49:31.823735812Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/20d3ef3a-5603-49e7-a89b-176457ccafcd
            correlation ID: 75d06690-940d-4212-a332-53f65ea86d06
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-20-nnnfjhqw4q7g/cluster-nightly-4-20-4mtrqs should provision
Unexpected error:
    <*fmt.wrapError | 0x1e45881b1020>: 
    failed to create HCP cluster cluster-nightly-4-20-4mtrqs: failed waiting for cluster="cluster-nightly-4-20-4mtrqs" in resourcegroup="rg-nightly-4-20-nnnfjhqw4q7g" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/20d3ef3a-5603-49e7-a89b-176457ccafcd
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/20d3ef3a-5603-49e7-a89b-176457ccafcd",
      "name": "20d3ef3a-5603-49e7-a89b-176457ccafcd",
      "status": "Failed",
      "startTime": "2026-10-11T23:20:27.297702896Z",
      "endTime": "2026-10-11T23:49:31.823735812Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/20d3ef3a-5603-49e7-a89b-176457ccafcd
            correlation ID: 75d06690-940d-4212-a332-53f65ea86d06
            client request ID: unavailable
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-c9kmmf" at install version 4.21.0-0.nightly-multi-2026-10-11-170003
Unexpected error:
    <*fmt.wrapError | 0x323f6ff48740>: 
    failed to create HCP cluster cp-ystream-upgrade-4-22-c9kmmf: failed waiting for cluster="cp-ystream-upgrade-4-22-c9kmmf" in resourcegroup="rg-cp-ystream-upgrade-4-22-lds8gpglp25k" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee",
      "name": "ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee",
      "status": "Failed",
      "startTime": "2026-10-11T23:26:08.511529037Z",
      "endTime": "2026-10-11T23:55:11.677255215Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee
            correlation ID: b7d51903-b039-4593-bd39-bbd75181cbd0
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-c9kmmf" at install version 4.21.0-0.nightly-multi-2026-10-11-170003
Unexpected error:
    <*fmt.wrapError | 0x323f6ff48740>: 
    failed to create HCP cluster cp-ystream-upgrade-4-22-c9kmmf: failed waiting for cluster="cp-ystream-upgrade-4-22-c9kmmf" in resourcegroup="rg-cp-ystream-upgrade-4-22-lds8gpglp25k" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee",
      "name": "ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee",
      "status": "Failed",
      "startTime": "2026-10-11T23:26:08.511529037Z",
      "endTime": "2026-10-11T23:55:11.677255215Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/ec5fa575-dd1b-4347-b7d7-0d42eb1c89ee
            correlation ID: b7d51903-b039-4593-bd39-bbd75181cbd0
            client request ID: unavailable
occurred