CIHealth
<
Single Day: Jul 3▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: STG

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 5
e2e (5)
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:02:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-lwpsmq/cluster-candidate-4-22-dqkclz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015228a0>: 
    failed to create HCP cluster cluster-candidate-4-22-dqkclz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-dqkclz in resource group rg-candidate-4-22-lwpsmq, error: failed waiting for cluster="cluster-candidate-4-22-dqkclz" in resourcegroup="rg-candidate-4-22-lwpsmq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-dqkclz in resource group rg-candidate-4-22-lwpsmq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-lwpsmq/cluster-candidate-4-22-dqkclz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015228a0>: 
    failed to create HCP cluster cluster-candidate-4-22-dqkclz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-dqkclz in resource group rg-candidate-4-22-lwpsmq, error: failed waiting for cluster="cluster-candidate-4-22-dqkclz" in resourcegroup="rg-candidate-4-22-lwpsmq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-dqkclz in resource group rg-candidate-4-22-lwpsmq, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
10:02:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-n5tq6q" for cluster "cluster-candidate-4-21-n5tq6q"
Unexpected error:
    <*fmt.wrapErrors | 0xc0028e9920>: 
    failed to create NodePool np-n5tq6q, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-n5tq6q in resource group rg-candidate-4-21-hwrssb, error: failed waiting for nodepool="np-n5tq6q" for cluster "cluster-candidate-4-21-n5tq6q" in resourcegroup="rg-candidate-4-21-hwrssb" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-n5tq6q" for cluster "cluster-candidate-4-21-n5tq6q"
Unexpected error:
    <*fmt.wrapErrors | 0xc0028e9920>: 
    failed to create NodePool np-n5tq6q, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-n5tq6q in resource group rg-candidate-4-21-hwrssb, error: failed waiting for nodepool="np-n5tq6q" for cluster "cluster-candidate-4-21-n5tq6q" in resourcegroup="rg-candidate-4-21-hwrssb" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:02:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-p87pwt/cluster-candidate-5-0-xss2vb should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0016e2e10>: 
    failed to create HCP cluster cluster-candidate-5-0-xss2vb, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-xss2vb in resource group rg-candidate-5-0-p87pwt, error: failed waiting for cluster="cluster-candidate-5-0-xss2vb" in resourcegroup="rg-candidate-5-0-p87pwt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-xss2vb in resource group rg-candidate-5-0-p87pwt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-p87pwt/cluster-candidate-5-0-xss2vb should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0016e2e10>: 
    failed to create HCP cluster cluster-candidate-5-0-xss2vb, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-xss2vb in resource group rg-candidate-5-0-p87pwt, error: failed waiting for cluster="cluster-candidate-5-0-xss2vb" in resourcegroup="rg-candidate-5-0-p87pwt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-xss2vb in resource group rg-candidate-5-0-p87pwt, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
10:02:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-zwrxjs" for cluster "cluster-candidate-4-20-zwrxjs"
Unexpected error:
    <*fmt.wrapErrors | 0xc001d1aea0>: 
    failed to create NodePool np-zwrxjs, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-zwrxjs in resource group rg-candidate-4-20-ctdjcb, error: failed waiting for nodepool="np-zwrxjs" for cluster "cluster-candidate-4-20-zwrxjs" in resourcegroup="rg-candidate-4-20-ctdjcb" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-zwrxjs" for cluster "cluster-candidate-4-20-zwrxjs"
Unexpected error:
    <*fmt.wrapErrors | 0xc001d1aea0>: 
    failed to create NodePool np-zwrxjs, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-zwrxjs in resource group rg-candidate-4-20-ctdjcb, error: failed waiting for nodepool="np-zwrxjs" for cluster "cluster-candidate-4-20-zwrxjs" in resourcegroup="rg-candidate-4-20-ctdjcb" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
10:02:08 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002990930>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-68bxll, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-68bxll" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002990930>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-68bxll, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-68bxll" to finish creating: context deadline exceeded
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 14
e2e (14)
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001046138>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-version-upgrade-cluster-fd7wxc" in resourcegroup="rg-np-version-upgrade-fd7wxc-h6kd44" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001046138>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-version-upgrade-cluster-fd7wxc" in resourcegroup="rg-np-version-upgrade-fd7wxc-h6kd44" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000c124c8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="oidc-wi-cluster" in resourcegroup="oidc-wi-h4hb29" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000c124c8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="oidc-wi-cluster" in resourcegroup="oidc-wi-h4hb29" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-vg4hqk" for cluster "cluster-candidate-4-20-vg4hqk"
Unexpected error:
    <*fmt.wrapErrors | 0xc0024a34d0>: 
    failed to create NodePool np-vg4hqk, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-vg4hqk in resource group rg-candidate-4-20-hq9wqg, error: failed waiting for nodepool="np-vg4hqk" for cluster "cluster-candidate-4-20-vg4hqk" in resourcegroup="rg-candidate-4-20-hq9wqg" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-vg4hqk" for cluster "cluster-candidate-4-20-vg4hqk"
Unexpected error:
    <*fmt.wrapErrors | 0xc0024a34d0>: 
    failed to create NodePool np-vg4hqk, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-vg4hqk in resource group rg-candidate-4-20-hq9wqg, error: failed waiting for nodepool="np-vg4hqk" for cluster "cluster-candidate-4-20-vg4hqk" in resourcegroup="rg-candidate-4-20-hq9wqg" to finish creating: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001430228>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-j8lscw" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001430228>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-j8lscw" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001338360>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-skip-minor-fxvbg6" in resourcegroup="rg-np-skip-minor-fxvbg6-pggjsw" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001338360>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-skip-minor-fxvbg6" in resourcegroup="rg-np-skip-minor-fxvbg6-pggjsw" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:07 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001be1dd0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-fncw96, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-fncw96" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001be1dd0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-fncw96, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-fncw96" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:07 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0013ee480>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-4qk94s, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-4qk94s" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0013ee480>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-4qk94s, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-4qk94s" to finish creating: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00273e2e8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="node-limit-cluster" in resourcegroup="node-limit-test-ckrxk9" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00273e2e8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="node-limit-cluster" in resourcegroup="node-limit-test-ckrxk9" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:07 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-cl6857/cluster-candidate-4-22-nvlv6d should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0010b00c0>: 
    failed to create HCP cluster cluster-candidate-4-22-nvlv6d, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-nvlv6d in resource group rg-candidate-4-22-cl6857, error: failed waiting for cluster="cluster-candidate-4-22-nvlv6d" in resourcegroup="rg-candidate-4-22-cl6857" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-nvlv6d in resource group rg-candidate-4-22-cl6857, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-cl6857/cluster-candidate-4-22-nvlv6d should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0010b00c0>: 
    failed to create HCP cluster cluster-candidate-4-22-nvlv6d, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-nvlv6d in resource group rg-candidate-4-22-cl6857, error: failed waiting for cluster="cluster-candidate-4-22-nvlv6d" in resourcegroup="rg-candidate-4-22-cl6857" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-nvlv6d in resource group rg-candidate-4-22-cl6857, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:07 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002a03c50>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-5nb65f, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-5nb65f" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc002a03c50>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-5nb65f, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-5nb65f" to finish creating: context deadline exceeded
    ...
occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000ece3d8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-dg-minor-gtd6pd" in resourcegroup="rg-np-dg-minor-gtd6pd-wtnrz7" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000ece3d8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-dg-minor-gtd6pd" in resourcegroup="rg-np-dg-minor-gtd6pd-wtnrz7" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0010d0708>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-version-upgrade-cluster-jszpnx" in resourcegroup="rg-np-version-upgrade-jszpnx-sbzxq2" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0010d0708>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-version-upgrade-cluster-jszpnx" in resourcegroup="rg-np-version-upgrade-jszpnx-sbzxq2" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0012ec258>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-downgrade-gncrr7" in resourcegroup="rg-np-downgrade-gncrr7-fmwxc7" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0012ec258>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-downgrade-gncrr7" in resourcegroup="rg-np-downgrade-gncrr7-fmwxc7" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
02:00:07 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001252048>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-noedge-mz9frr" in resourcegroup="rg-np-noedge-mz9frr-9l95c5" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001252048>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-noedge-mz9frr" in resourcegroup="rg-np-noedge-mz9frr-9l95c5" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 6
e2e (6)
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
00:21:04 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00232b710>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-lgvgbh, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-lgvgbh" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00232b710>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-lgvgbh, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-lgvgbh" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
00:21:04 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-qb294n" for cluster "cluster-candidate-4-21-qb294n"
Unexpected error:
    <*fmt.wrapErrors | 0xc0027ec870>: 
    failed to create NodePool np-qb294n, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-qb294n in resource group rg-candidate-4-21-9csn4d, error: failed waiting for nodepool="np-qb294n" for cluster "cluster-candidate-4-21-qb294n" in resourcegroup="rg-candidate-4-21-9csn4d" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-qb294n" for cluster "cluster-candidate-4-21-qb294n"
Unexpected error:
    <*fmt.wrapErrors | 0xc0027ec870>: 
    failed to create NodePool np-qb294n, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-qb294n in resource group rg-candidate-4-21-9csn4d, error: failed waiting for nodepool="np-qb294n" for cluster "cluster-candidate-4-21-qb294n" in resourcegroup="rg-candidate-4-21-9csn4d" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
00:21:04 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-mdt4sp/cluster-candidate-4-22-bmbbmp should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015e68d0>: 
    failed to create HCP cluster cluster-candidate-4-22-bmbbmp, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-bmbbmp in resource group rg-candidate-4-22-mdt4sp, error: failed waiting for cluster="cluster-candidate-4-22-bmbbmp" in resourcegroup="rg-candidate-4-22-mdt4sp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-bmbbmp in resource group rg-candidate-4-22-mdt4sp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-mdt4sp/cluster-candidate-4-22-bmbbmp should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015e68d0>: 
    failed to create HCP cluster cluster-candidate-4-22-bmbbmp, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-bmbbmp in resource group rg-candidate-4-22-mdt4sp, error: failed waiting for cluster="cluster-candidate-4-22-bmbbmp" in resourcegroup="rg-candidate-4-22-mdt4sp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-bmbbmp in resource group rg-candidate-4-22-mdt4sp, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
00:21:04 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-2n2bn6" for cluster "cluster-candidate-4-20-2n2bn6"
Unexpected error:
    <*fmt.wrapErrors | 0xc0020ea5a0>: 
    failed to create NodePool np-2n2bn6, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-2n2bn6 in resource group rg-candidate-4-20-sxqkm6, error: failed waiting for nodepool="np-2n2bn6" for cluster "cluster-candidate-4-20-2n2bn6" in resourcegroup="rg-candidate-4-20-sxqkm6" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-2n2bn6" for cluster "cluster-candidate-4-20-2n2bn6"
Unexpected error:
    <*fmt.wrapErrors | 0xc0020ea5a0>: 
    failed to create NodePool np-2n2bn6, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-2n2bn6 in resource group rg-candidate-4-20-sxqkm6, error: failed waiting for nodepool="np-2n2bn6" for cluster "cluster-candidate-4-20-2n2bn6" in resourcegroup="rg-candidate-4-20-sxqkm6" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
00:21:04 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-d5zr7j/cluster-candidate-5-0-rxmj56 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015f27b0>: 
    failed to create HCP cluster cluster-candidate-5-0-rxmj56, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-rxmj56 in resource group rg-candidate-5-0-d5zr7j, error: failed waiting for cluster="cluster-candidate-5-0-rxmj56" in resourcegroup="rg-candidate-5-0-d5zr7j" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-rxmj56 in resource group rg-candidate-5-0-d5zr7j, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-d5zr7j/cluster-candidate-5-0-rxmj56 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015f27b0>: 
    failed to create HCP cluster cluster-candidate-5-0-rxmj56, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-rxmj56 in resource group rg-candidate-5-0-d5zr7j, error: failed waiting for cluster="cluster-candidate-5-0-rxmj56" in resourcegroup="rg-candidate-5-0-d5zr7j" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-rxmj56 in resource group rg-candidate-5-0-d5zr7j, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
00:21:04 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc0029151a0>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-gt6qbd, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-gt6qbd" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:148]: failed to create AZ nodepool autoscale-az with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc0029151a0>: 
    failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-gt6qbd, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-gt6qbd" to finish creating: context deadline exceeded
    ...
occurred