<
Single Day: Jul 2
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: STG

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 8
e2e (8)
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-mw7g87/cluster-nightly-4-23-b45mnx should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a30de0>: 
    failed to create HCP cluster cluster-nightly-4-23-b45mnx, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-b45mnx in resource group rg-nightly-4-23-mw7g87, error: failed waiting for cluster="cluster-nightly-4-23-b45mnx" in resourcegroup="rg-nightly-4-23-mw7g87" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-b45mnx in resource group rg-nightly-4-23-mw7g87, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-mw7g87/cluster-nightly-4-23-b45mnx should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a30de0>: 
    failed to create HCP cluster cluster-nightly-4-23-b45mnx, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-b45mnx in resource group rg-nightly-4-23-mw7g87, error: failed waiting for cluster="cluster-nightly-4-23-b45mnx" in resourcegroup="rg-nightly-4-23-mw7g87" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-b45mnx in resource group rg-nightly-4-23-mw7g87, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.21 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-qmdzh7" for cluster "cluster-nightly-4-21-qmdzh7"
Unexpected error:
    <*fmt.wrapErrors | 0xc00248cb70>: 
    failed to create NodePool np-qmdzh7, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-qmdzh7 in resource group rg-nightly-4-21-9qp8z9, error: failed waiting for nodepool="np-qmdzh7" for cluster "cluster-nightly-4-21-qmdzh7" in resourcegroup="rg-nightly-4-21-9qp8z9" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-qmdzh7" for cluster "cluster-nightly-4-21-qmdzh7"
Unexpected error:
    <*fmt.wrapErrors | 0xc00248cb70>: 
    failed to create NodePool np-qmdzh7, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-qmdzh7 in resource group rg-nightly-4-21-9qp8z9, error: failed waiting for nodepool="np-qmdzh7" for cluster "cluster-nightly-4-21-qmdzh7" in resourcegroup="rg-nightly-4-21-9qp8z9" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-lfd24m" for cluster "cluster-nightly-4-22-lfd24m"
Unexpected error:
    <*fmt.wrapErrors | 0xc002591560>: 
    failed to create NodePool np-lfd24m, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-lfd24m in resource group rg-nightly-4-22-lmmw4z, error: failed waiting for nodepool="np-lfd24m" for cluster "cluster-nightly-4-22-lfd24m" in resourcegroup="rg-nightly-4-22-lmmw4z" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-lfd24m" for cluster "cluster-nightly-4-22-lfd24m"
Unexpected error:
    <*fmt.wrapErrors | 0xc002591560>: 
    failed to create NodePool np-lfd24m, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-lfd24m in resource group rg-nightly-4-22-lmmw4z, error: failed waiting for nodepool="np-lfd24m" for cluster "cluster-nightly-4-22-lfd24m" in resourcegroup="rg-nightly-4-22-lmmw4z" to finish creating: context deadline exceeded
    ...
occurred
client rate limiter Wait returned an error: context deadline exceeded
23:00:07 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc001e38480>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-zvscj7, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-zvscj7" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc001e38480>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-zvscj7, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-zvscj7" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:07 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002a0b620>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-n9df2b, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-n9df2b" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002a0b620>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-n9df2b, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-n9df2b" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:07 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc0026f1410>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-45ldvl, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-45ldvl" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc0026f1410>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-45ldvl, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-45ldvl" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-8skd5b" for cluster "cluster-nightly-4-20-8skd5b"
Unexpected error:
    <*fmt.wrapErrors | 0xc0028a7680>: 
    failed to create NodePool np-8skd5b, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-8skd5b in resource group rg-nightly-4-20-dvmp6t, error: failed waiting for nodepool="np-8skd5b" for cluster "cluster-nightly-4-20-8skd5b" in resourcegroup="rg-nightly-4-20-dvmp6t" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-8skd5b" for cluster "cluster-nightly-4-20-8skd5b"
Unexpected error:
    <*fmt.wrapErrors | 0xc0028a7680>: 
    failed to create NodePool np-8skd5b, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-8skd5b in resource group rg-nightly-4-20-dvmp6t, error: failed waiting for nodepool="np-8skd5b" for cluster "cluster-nightly-4-20-8skd5b" in resourcegroup="rg-nightly-4-20-dvmp6t" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.0 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-5-0-mn6b27/cluster-nightly-5-0-7sf6qf should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001486090>: 
    failed to create HCP cluster cluster-nightly-5-0-7sf6qf, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-7sf6qf in resource group rg-nightly-5-0-mn6b27, error: failed waiting for cluster="cluster-nightly-5-0-7sf6qf" in resourcegroup="rg-nightly-5-0-mn6b27" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-7sf6qf in resource group rg-nightly-5-0-mn6b27, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-5-0-mn6b27/cluster-nightly-5-0-7sf6qf should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001486090>: 
    failed to create HCP cluster cluster-nightly-5-0-7sf6qf, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-7sf6qf in resource group rg-nightly-5-0-mn6b27, error: failed waiting for cluster="cluster-nightly-5-0-7sf6qf" in resourcegroup="rg-nightly-5-0-mn6b27" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-7sf6qf in resource group rg-nightly-5-0-mn6b27, error: context deadline exceeded
    ...
occurred
branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 1
e2e (1)
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
10:08:37 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002340990>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-9gq4xd, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-9gq4xd" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002340990>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-9gq4xd, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-9gq4xd" to finish creating: context deadline exceeded
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 27
e2e (27)
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:86]: failed to create HCP cluster for external auth list test
Unexpected error:
    <*fmt.wrapErrors | 0xc000cf02d0>: 
    failed to create HCP cluster ea-list447r96, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list447r96 in resource group ea-list-fxlfg8, error: failed waiting for cluster="ea-list447r96" in resourcegroup="ea-list-fxlfg8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list447r96 in resource group ea-list-fxlfg8, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:86]: failed to create HCP cluster for external auth list test
Unexpected error:
    <*fmt.wrapErrors | 0xc000cf02d0>: 
    failed to create HCP cluster ea-list447r96, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list447r96 in resource group ea-list-fxlfg8, error: failed waiting for cluster="ea-list447r96" in resourcegroup="ea-list-fxlfg8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list447r96 in resource group ea-list-fxlfg8, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-srwxkf/cluster-candidate-5-0-x94n2m should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000f8ec60>: 
    failed to create HCP cluster cluster-candidate-5-0-x94n2m, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-x94n2m in resource group rg-candidate-5-0-srwxkf, error: failed waiting for cluster="cluster-candidate-5-0-x94n2m" in resourcegroup="rg-candidate-5-0-srwxkf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-x94n2m in resource group rg-candidate-5-0-srwxkf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-srwxkf/cluster-candidate-5-0-x94n2m should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000f8ec60>: 
    failed to create HCP cluster cluster-candidate-5-0-x94n2m, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-x94n2m in resource group rg-candidate-5-0-srwxkf, error: failed waiting for cluster="cluster-candidate-5-0-x94n2m" in resourcegroup="rg-candidate-5-0-srwxkf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-x94n2m in resource group rg-candidate-5-0-srwxkf, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints
Unexpected error:
    <*fmt.wrapErrors | 0xc000e4a240>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-7hlj6p, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-7hlj6p" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-7hlj6p, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints
Unexpected error:
    <*fmt.wrapErrors | 0xc000e4a240>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-7hlj6p, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-7hlj6p" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-7hlj6p, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test
Unexpected error:
    <*fmt.wrapErrors | 0xc00108c570>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-gxv99w, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-gxv99w" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-gxv99w, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test
Unexpected error:
    <*fmt.wrapErrors | 0xc00108c570>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-gxv99w, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-gxv99w" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-gxv99w, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-22-j9t7jk" with version 4.22.1 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00170a9c0>: 
    failed to create HCP cluster cluster-zstream-4-22-j9t7jk, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-j9t7jk in resource group rg-zstream-upgrade-4-22-xpsjmq, error: failed waiting for cluster="cluster-zstream-4-22-j9t7jk" in resourcegroup="rg-zstream-upgrade-4-22-xpsjmq" to finish creating, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-j9t7jk in resource group rg-zstream-upgrade-4-22-xpsjmq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-22-j9t7jk" with version 4.22.1 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00170a9c0>: 
    failed to create HCP cluster cluster-zstream-4-22-j9t7jk, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-j9t7jk in resource group rg-zstream-upgrade-4-22-xpsjmq, error: failed waiting for cluster="cluster-zstream-4-22-j9t7jk" in resourcegroup="rg-zstream-upgrade-4-22-xpsjmq" to finish creating, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-j9t7jk in resource group rg-zstream-upgrade-4-22-xpsjmq, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0009d0990>: 
    failed to create HCP cluster np-dg-minor-rbqtnj, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-rbqtnj in resource group rg-np-dg-minor-rbqtnj-vms8wt, error: failed waiting for cluster="np-dg-minor-rbqtnj" in resourcegroup="rg-np-dg-minor-rbqtnj-vms8wt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-rbqtnj in resource group rg-np-dg-minor-rbqtnj-vms8wt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0009d0990>: 
    failed to create HCP cluster np-dg-minor-rbqtnj, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-rbqtnj in resource group rg-np-dg-minor-rbqtnj-vms8wt, error: failed waiting for cluster="np-dg-minor-rbqtnj" in resourcegroup="rg-np-dg-minor-rbqtnj-vms8wt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-rbqtnj in resource group rg-np-dg-minor-rbqtnj-vms8wt, error: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:06 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001c143f0>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-rp48cp" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001c143f0>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-rp48cp" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-k2kjb2 with version 4.21.22
Unexpected error:
    <*fmt.wrapErrors | 0xc000e7b6e0>: 
    failed to create HCP cluster np-version-upgrade-cluster-k2kjb2, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-k2kjb2 in resource group rg-np-version-upgrade-k2kjb2-lnm7gm, error: failed waiting for cluster="np-version-upgrade-cluster-k2kjb2" in resourcegroup="rg-np-version-upgrade-k2kjb2-lnm7gm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-k2kjb2 in resource group rg-np-version-upgrade-k2kjb2-lnm7gm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-k2kjb2 with version 4.21.22
Unexpected error:
    <*fmt.wrapErrors | 0xc000e7b6e0>: 
    failed to create HCP cluster np-version-upgrade-cluster-k2kjb2, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-k2kjb2 in resource group rg-np-version-upgrade-k2kjb2-lnm7gm, error: failed waiting for cluster="np-version-upgrade-cluster-k2kjb2" in resourcegroup="rg-np-version-upgrade-k2kjb2-lnm7gm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-k2kjb2 in resource group rg-np-version-upgrade-k2kjb2-lnm7gm, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:459]: failed to create HCP cluster np-skip-minor-rhlphl at version 4.22.3
Unexpected error:
    <*fmt.wrapErrors | 0xc0006c8690>: 
    failed to create HCP cluster np-skip-minor-rhlphl, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-rhlphl in resource group rg-np-skip-minor-rhlphl-fgwxhc, error: failed waiting for cluster="np-skip-minor-rhlphl" in resourcegroup="rg-np-skip-minor-rhlphl-fgwxhc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-rhlphl in resource group rg-np-skip-minor-rhlphl-fgwxhc, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:459]: failed to create HCP cluster np-skip-minor-rhlphl at version 4.22.3
Unexpected error:
    <*fmt.wrapErrors | 0xc0006c8690>: 
    failed to create HCP cluster np-skip-minor-rhlphl, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-rhlphl in resource group rg-np-skip-minor-rhlphl-fgwxhc, error: failed waiting for cluster="np-skip-minor-rhlphl" in resourcegroup="rg-np-skip-minor-rhlphl-fgwxhc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-rhlphl in resource group rg-np-skip-minor-rhlphl-fgwxhc, error: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:06 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000ccc2e8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-zstream-4-20-sn4mb4" in resourcegroup="rg-zstream-upgrade-4-20-4p2hrd" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000ccc2e8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-zstream-4-20-sn4mb4" in resourcegroup="rg-zstream-upgrade-4-20-4p2hrd" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc0014826c0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-cxlml6, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-cxlml6" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-cxlml6, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc0014826c0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-cxlml6, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-cxlml6" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-cxlml6, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0014bc420>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-x4kh7h, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-x4kh7h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-x4kh7h, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0014bc420>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-x4kh7h, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-x4kh7h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-x4kh7h, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test
Unexpected error:
    <*fmt.wrapErrors | 0xc00138a5d0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-5gngpb, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-5gngpb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-5gngpb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test
Unexpected error:
    <*fmt.wrapErrors | 0xc00138a5d0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-5gngpb, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-5gngpb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-5gngpb, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk
Unexpected error:
    <*fmt.wrapErrors | 0xc0010e60c0>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-7cgh88, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-7cgh88" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-7cgh88, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk
Unexpected error:
    <*fmt.wrapErrors | 0xc0010e60c0>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-7cgh88, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-7cgh88" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-7cgh88, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-54kh4j with version 4.21.22
Unexpected error:
    <*fmt.wrapErrors | 0xc000b48f90>: 
    failed to create HCP cluster np-version-upgrade-cluster-54kh4j, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-54kh4j in resource group rg-np-version-upgrade-54kh4j-78br5q, error: failed waiting for cluster="np-version-upgrade-cluster-54kh4j" in resourcegroup="rg-np-version-upgrade-54kh4j-78br5q" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-54kh4j in resource group rg-np-version-upgrade-54kh4j-78br5q, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-54kh4j with version 4.21.22
Unexpected error:
    <*fmt.wrapErrors | 0xc000b48f90>: 
    failed to create HCP cluster np-version-upgrade-cluster-54kh4j, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-54kh4j in resource group rg-np-version-upgrade-54kh4j-78br5q, error: failed waiting for cluster="np-version-upgrade-cluster-54kh4j" in resourcegroup="rg-np-version-upgrade-54kh4j-78br5q" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-54kh4j in resource group rg-np-version-upgrade-54kh4j-78br5q, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:151]: failed to create node pool npupgrade-4-20 with version 4.20.26
Unexpected error:
    <*fmt.wrapErrors | 0xc002b82c30>: 
    failed to create NodePool npupgrade-4-20, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-20 in resource group rg-np-version-upgrade-m7kf2c-lhl6lj, error: failed waiting for nodepool="npupgrade-4-20" for cluster "np-version-upgrade-cluster-m7kf2c" in resourcegroup="rg-np-version-upgrade-m7kf2c-lhl6lj" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:151]: failed to create node pool npupgrade-4-20 with version 4.20.26
Unexpected error:
    <*fmt.wrapErrors | 0xc002b82c30>: 
    failed to create NodePool npupgrade-4-20, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-20 in resource group rg-np-version-upgrade-m7kf2c-lhl6lj, error: failed waiting for nodepool="npupgrade-4-20" for cluster "np-version-upgrade-cluster-m7kf2c" in resourcegroup="rg-np-version-upgrade-m7kf2c-lhl6lj" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001680450>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-nlq6nf, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-nlq6nf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-nlq6nf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001680450>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-nlq6nf, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-nlq6nf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-nlq6nf, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:284]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit
Unexpected error:
    <*fmt.wrapErrors | 0xc00188e090>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-t8j2gl, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-t8j2gl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-t8j2gl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:284]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit
Unexpected error:
    <*fmt.wrapErrors | 0xc00188e090>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-t8j2gl, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-t8j2gl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-t8j2gl, error: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:06 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.19 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00190c168>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-zstream-4-19-5wmrnm" in resourcegroup="rg-zstream-upgrade-4-19-l9cvg8" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00190c168>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-zstream-4-19-5wmrnm" in resourcegroup="rg-zstream-upgrade-4-19-l9cvg8" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:06 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00158e198>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-m5x4n6" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00158e198>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-m5x4n6" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-21-2zfntn" with version 4.21.0-rc.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc001660ae0>: 
    failed to create HCP cluster cluster-zstream-4-21-2zfntn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-2zfntn in resource group rg-zstream-upgrade-4-21-9xcxtp, error: failed waiting for cluster="cluster-zstream-4-21-2zfntn" in resourcegroup="rg-zstream-upgrade-4-21-9xcxtp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-2zfntn in resource group rg-zstream-upgrade-4-21-9xcxtp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-21-2zfntn" with version 4.21.0-rc.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc001660ae0>: 
    failed to create HCP cluster cluster-zstream-4-21-2zfntn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-2zfntn in resource group rg-zstream-upgrade-4-21-9xcxtp, error: failed waiting for cluster="cluster-zstream-4-21-2zfntn" in resourcegroup="rg-zstream-upgrade-4-21-9xcxtp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-2zfntn in resource group rg-zstream-upgrade-4-21-9xcxtp, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000a22030>: 
    failed to create HCP cluster np-downgrade-bqqlsh, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-bqqlsh in resource group rg-np-downgrade-bqqlsh-cv44x5, error: failed waiting for cluster="np-downgrade-bqqlsh" in resourcegroup="rg-np-downgrade-bqqlsh-cv44x5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-bqqlsh in resource group rg-np-downgrade-bqqlsh-cv44x5, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000a22030>: 
    failed to create HCP cluster np-downgrade-bqqlsh, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-bqqlsh in resource group rg-np-downgrade-bqqlsh-cv44x5, error: failed waiting for cluster="np-downgrade-bqqlsh" in resourcegroup="rg-np-downgrade-bqqlsh-cv44x5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-bqqlsh in resource group rg-np-downgrade-bqqlsh-cv44x5, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled
Unexpected error:
    <*fmt.wrapErrors | 0xc0013a8270>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-p9k8wt, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-p9k8wt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-p9k8wt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled
Unexpected error:
    <*fmt.wrapErrors | 0xc0013a8270>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-p9k8wt, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-p9k8wt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-p9k8wt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-ntcvmj
Unexpected error:
    <*fmt.wrapErrors | 0xc0013673b0>: 
    failed to create HCP cluster np-noedge-ntcvmj, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-ntcvmj in resource group rg-np-noedge-ntcvmj-5szqt9, error: failed waiting for cluster="np-noedge-ntcvmj" in resourcegroup="rg-np-noedge-ntcvmj-5szqt9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-ntcvmj in resource group rg-np-noedge-ntcvmj-5szqt9, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-ntcvmj
Unexpected error:
    <*fmt.wrapErrors | 0xc0013673b0>: 
    failed to create HCP cluster np-noedge-ntcvmj, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-ntcvmj in resource group rg-np-noedge-ntcvmj-5szqt9, error: failed waiting for cluster="np-noedge-ntcvmj" in resourcegroup="rg-np-noedge-ntcvmj-5szqt9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-ntcvmj in resource group rg-np-noedge-ntcvmj-5szqt9, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0013c8720>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-tzxzrq, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-tzxzrq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-tzxzrq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0013c8720>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-tzxzrq, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-tzxzrq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-tzxzrq, error: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:06 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000970270>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-rqdwnd" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000970270>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-rqdwnd" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:97]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc002550a20>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-l857pf, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-l857pf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-l857pf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:97]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc002550a20>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-l857pf, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-l857pf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-l857pf, error: context deadline exceeded
    ...
occurred