CIHealth
<
Single Day: May 14▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 38
e2e (38)
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc00098c030>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-hb7cwk, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-hb7cwk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-hb7cwk, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc00098c030>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-hb7cwk, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-hb7cwk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-hb7cwk, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc00179e420>: 
    failed to create HCP cluster ea-list2jmfs9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list2jmfs9 in resource group ea-list-gmvwdz, error: failed waiting for cluster="ea-list2jmfs9" in resourcegroup="ea-list-gmvwdz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list2jmfs9 in resource group ea-list-gmvwdz, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc00179e420>: 
    failed to create HCP cluster ea-list2jmfs9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list2jmfs9 in resource group ea-list-gmvwdz, error: failed waiting for cluster="ea-list2jmfs9" in resourcegroup="ea-list-gmvwdz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list2jmfs9 in resource group ea-list-gmvwdz, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:130]: Unexpected error:
    <*fmt.wrapErrors | 0xc00127e9c0>: 
    failed to create HCP cluster np-version-upgrade-cluster-dkl7b2, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-dkl7b2 in resource group rg-np-version-upgrade-dkl7b2-gf6c77, error: failed waiting for cluster="np-version-upgrade-cluster-dkl7b2" in resourcegroup="rg-np-version-upgrade-dkl7b2-gf6c77" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-dkl7b2 in resource group rg-np-version-upgrade-dkl7b2-gf6c77, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:130]: Unexpected error:
    <*fmt.wrapErrors | 0xc00127e9c0>: 
    failed to create HCP cluster np-version-upgrade-cluster-dkl7b2, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-dkl7b2 in resource group rg-np-version-upgrade-dkl7b2-gf6c77, error: failed waiting for cluster="np-version-upgrade-cluster-dkl7b2" in resourcegroup="rg-np-version-upgrade-dkl7b2-gf6c77" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-dkl7b2 in resource group rg-np-version-upgrade-dkl7b2-gf6c77, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009a2b40>: 
    failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-x66jwk, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-x66jwk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-x66jwk, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009a2b40>: 
    failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-x66jwk, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-x66jwk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-x66jwk, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:276]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d2aa20>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-swkjf5, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-swkjf5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-swkjf5, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:276]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d2aa20>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-swkjf5, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-swkjf5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-swkjf5, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc001404e10>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-lmds79, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-lmds79" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-lmds79, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc001404e10>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-lmds79, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-lmds79" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-lmds79, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc001680bd0>: 
    failed to create HCP cluster cluster-candidate-4-20-5vcgvn, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-20-5vcgvn in resource group rg-candidate-4-20-stcbzv, error: failed waiting for cluster="cluster-candidate-4-20-5vcgvn" in resourcegroup="rg-candidate-4-20-stcbzv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-20-5vcgvn in resource group rg-candidate-4-20-stcbzv, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc001680bd0>: 
    failed to create HCP cluster cluster-candidate-4-20-5vcgvn, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-20-5vcgvn in resource group rg-candidate-4-20-stcbzv, error: failed waiting for cluster="cluster-candidate-4-20-5vcgvn" in resourcegroup="rg-candidate-4-20-stcbzv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-20-5vcgvn in resource group rg-candidate-4-20-stcbzv, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009e0b10>: 
    failed to create HCP cluster cluster-zstream-4-21-cn88z9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-cn88z9 in resource group rg-zstream-upgrade-4-21-rv459w, error: failed waiting for cluster="cluster-zstream-4-21-cn88z9" in resourcegroup="rg-zstream-upgrade-4-21-rv459w" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-cn88z9 in resource group rg-zstream-upgrade-4-21-rv459w, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009e0b10>: 
    failed to create HCP cluster cluster-zstream-4-21-cn88z9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-cn88z9 in resource group rg-zstream-upgrade-4-21-rv459w, error: failed waiting for cluster="cluster-zstream-4-21-cn88z9" in resourcegroup="rg-zstream-upgrade-4-21-rv459w" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-cn88z9 in resource group rg-zstream-upgrade-4-21-rv459w, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: Unexpected error:
    <*fmt.wrapErrors | 0xc00140a7e0>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-bkbvvz, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-bkbvvz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-bkbvvz, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: Unexpected error:
    <*fmt.wrapErrors | 0xc00140a7e0>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-bkbvvz, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-bkbvvz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-bkbvvz, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:257]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e404b0>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-ptfshz, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-ptfshz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-ptfshz, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:257]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e404b0>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-ptfshz, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-ptfshz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-ptfshz, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc00150ced0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-8jpljh, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-8jpljh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-8jpljh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc00150ced0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-8jpljh, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-8jpljh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-8jpljh, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: Unexpected error:
    <*fmt.wrapErrors | 0xc00179a090>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-klc544, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-klc544" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-klc544, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: Unexpected error:
    <*fmt.wrapErrors | 0xc00179a090>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-klc544, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-klc544" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-klc544, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:108]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fe23c0>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-ff64hq" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-ff64hq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:108]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fe23c0>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-ff64hq" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-ff64hq, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc001321050>: 
    failed to create HCP cluster cluster-zstream-4-19-qklpcl, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-qklpcl in resource group rg-zstream-upgrade-4-19-db8wwl, error: failed waiting for cluster="cluster-zstream-4-19-qklpcl" in resourcegroup="rg-zstream-upgrade-4-19-db8wwl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-qklpcl in resource group rg-zstream-upgrade-4-19-db8wwl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc001321050>: 
    failed to create HCP cluster cluster-zstream-4-19-qklpcl, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-qklpcl in resource group rg-zstream-upgrade-4-19-db8wwl, error: failed waiting for cluster="cluster-zstream-4-19-qklpcl" in resourcegroup="rg-zstream-upgrade-4-19-db8wwl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-qklpcl in resource group rg-zstream-upgrade-4-19-db8wwl, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc0007f9f20>: 
    failed to create HCP cluster cluster-candidate-4-22-mcgk9b, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-22-mcgk9b in resource group rg-candidate-4-22-zj5dl9, error: failed waiting for cluster="cluster-candidate-4-22-mcgk9b" in resourcegroup="rg-candidate-4-22-zj5dl9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-22-mcgk9b in resource group rg-candidate-4-22-zj5dl9, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc0007f9f20>: 
    failed to create HCP cluster cluster-candidate-4-22-mcgk9b, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-22-mcgk9b in resource group rg-candidate-4-22-zj5dl9, error: failed waiting for cluster="cluster-candidate-4-22-mcgk9b" in resourcegroup="rg-candidate-4-22-zj5dl9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-22-mcgk9b in resource group rg-candidate-4-22-zj5dl9, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: Unexpected error:
    <*fmt.wrapErrors | 0xc001445380>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8clc2q, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8clc2q" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8clc2q, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: Unexpected error:
    <*fmt.wrapErrors | 0xc001445380>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8clc2q, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8clc2q" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8clc2q, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc00120f020>: 
    failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-fpdn2w, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-fpdn2w" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-fpdn2w, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc00120f020>: 
    failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-fpdn2w, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-fpdn2w" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-fpdn2w, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:130]: Unexpected error:
    <*fmt.wrapErrors | 0xc000c20720>: 
    failed to create HCP cluster np-version-upgrade-cluster-gkwjwp, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-gkwjwp in resource group rg-np-version-upgrade-gkwjwp-g46jd6, error: failed waiting for cluster="np-version-upgrade-cluster-gkwjwp" in resourcegroup="rg-np-version-upgrade-gkwjwp-g46jd6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-gkwjwp in resource group rg-np-version-upgrade-gkwjwp-g46jd6, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:130]: Unexpected error:
    <*fmt.wrapErrors | 0xc000c20720>: 
    failed to create HCP cluster np-version-upgrade-cluster-gkwjwp, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-gkwjwp in resource group rg-np-version-upgrade-gkwjwp-g46jd6, error: failed waiting for cluster="np-version-upgrade-cluster-gkwjwp" in resourcegroup="rg-np-version-upgrade-gkwjwp-g46jd6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-gkwjwp in resource group rg-np-version-upgrade-gkwjwp-g46jd6, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011feff0>: 
    failed to create HCP cluster cluster-zstream-4-20-rdwv4z, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-rdwv4z in resource group rg-zstream-upgrade-4-20-szt84k, error: failed waiting for cluster="cluster-zstream-4-20-rdwv4z" in resourcegroup="rg-zstream-upgrade-4-20-szt84k" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-rdwv4z in resource group rg-zstream-upgrade-4-20-szt84k, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011feff0>: 
    failed to create HCP cluster cluster-zstream-4-20-rdwv4z, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-rdwv4z in resource group rg-zstream-upgrade-4-20-szt84k, error: failed waiting for cluster="cluster-zstream-4-20-rdwv4z" in resourcegroup="rg-zstream-upgrade-4-20-szt84k" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-rdwv4z in resource group rg-zstream-upgrade-4-20-szt84k, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:126]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e5c7e0>: 
    failed to create HCP cluster cp-ystream-upgrade-4-21-btgxrm, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-btgxrm in resource group rg-cp-ystream-upgrade-4-21-5s52q7, error: failed waiting for cluster="cp-ystream-upgrade-4-21-btgxrm" in resourcegroup="rg-cp-ystream-upgrade-4-21-5s52q7" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-btgxrm in resource group rg-cp-ystream-upgrade-4-21-5s52q7, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:126]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e5c7e0>: 
    failed to create HCP cluster cp-ystream-upgrade-4-21-btgxrm, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-btgxrm in resource group rg-cp-ystream-upgrade-4-21-5s52q7, error: failed waiting for cluster="cp-ystream-upgrade-4-21-btgxrm" in resourcegroup="rg-cp-ystream-upgrade-4-21-5s52q7" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-btgxrm in resource group rg-cp-ystream-upgrade-4-21-5s52q7, error: context deadline exceeded
    ...
occurred
Deserializaion Error: no output from command
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite prod/parallel
Show raw failure
nt progress report:
      Customer should be able to create an HCP cluster with custom autoscaling (Spec Runtime: 2h29m59.884s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:36
        In [It] (Node Runtime: 2h29m59.884s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:36
          At [By Step] creating the cluster (Step Runtime: 13m58.964s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:90

          Spec Goroutine
          goroutine 114 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8e29e48, 0xc000bfafa0}, 0x82faaf2?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8e66d20, {0x8e29e48, 0xc000bfafa0}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8e29eb8?, 0xc000946150?}, {{0x8e42958?, 0xc000933000?}, 0xc0014c2e28?}, 0xc00008f720, {0xc00153b140, 0x1a}, {0x833717c, 0x17}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:852
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc0013d3c47, 0x7}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:346
          > github.com/Azure/ARO-HCP/test/e2e.init.func6.2({0x7f6588241860, 0xc000e02f00})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:91
                | 
                | By("creating the cluster")
                > err = tc.CreateHCPClusterFromParam(ctx,
                | 	GinkgoLogr,
                | 	*resourceGroup.Name,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8e42a30?, 0xc000e02f00?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 111
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97 @ 05/14/26 05:30:00.521
  "ts"="2026-05-14 05:30:00.521474" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-05-14 05:30:00.521545" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-autoscaling-hcp-cluster-g9ldv2" "resourceGroup"="autoscaling-cluster-lfddg6"
  "ts"="2026-05-14 05:30:00.618320" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-autoscaling-hcp-cluster-g9ldv2" "resourceGroup"=""
  "ts"="2026-05-14 05:30:02.019461" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-31a71a35884d87a4a1de36eceeb324011e1c775154472da33ffc40cde64c08cb.yaml.gz"
  "ts"="2026-05-14 05:30:02.019562" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-31a71a35884d87a4a1de36eceeb324011e1c775154472da33ffc40cde64c08cb.yaml.gz"
  "ts"="2026-05-14 05:30:02.019614" "level"=0 "msg"="collecting debug info"
  "ts"="2026-05-14 05:30:02.021044" "level"=0 "msg"="collecting deployments" "resourceGroup"="autoscaling-cluster-lfddg6"
  "ts"="2026-05-14 05:30:02.021025" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-12"
  "ts"="2026-05-14 05:30:02.340783" "level"=0 "msg"="collecting operations" "resourceGroup"="autoscaling-cluster-lfddg6" "deployment"="pooledNonMsiScopedAssignments-e4ixwyxsfjnje"
  "ts"="2026-05-14 05:30:02.389983" "level"=0 "msg"="collecting operations" "resourceGroup"="autoscaling-cluster-lfddg6" "deployment"="customer-infra-autoscaling-hcp-cluster-g9ldv2"
  "ts"="2026-05-14 05:30:02.843289" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-12" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-05-14 05:30:03.312787" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-12" "deployment"="msi-deployment-12"
  "ts"="2026-05-14 05:30:03.420865" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-05-14 05:30:04.407214" "level"=0 "msg"="deleting created resources"
  "ts"="2026-05-14 05:30:04.407388" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="autoscaling-cluster-lfddg6"
Command Error: signal: killed
Deserializaion Error: no output from command
nt progress report:
      Customer should be able to create an HCP cluster with custom autoscaling (Spec Runtime: 2h29m59.884s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:36
        In [It] (Node Runtime: 2h29m59.884s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:36
          At [By Step] creating the cluster (Step Runtime: 13m58.964s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:90

          Spec Goroutine
          goroutine 114 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8e29e48, 0xc000bfafa0}, 0x82faaf2?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8e66d20, {0x8e29e48, 0xc000bfafa0}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8e29eb8?, 0xc000946150?}, {{0x8e42958?, 0xc000933000?}, 0xc0014c2e28?}, 0xc00008f720, {0xc00153b140, 0x1a}, {0x833717c, 0x17}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:852
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc0013d3c47, 0x7}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:346
          > github.com/Azure/ARO-HCP/test/e2e.init.func6.2({0x7f6588241860, 0xc000e02f00})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:91
                | 
                | By("creating the cluster")
                > err = tc.CreateHCPClusterFromParam(ctx,
                | 	GinkgoLogr,
                | 	*resourceGroup.Name,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8e42a30?, 0xc000e02f00?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 111
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97 @ 05/14/26 05:30:00.521
  "ts"="2026-05-14 05:30:00.521474" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-05-14 05:30:00.521545" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-autoscaling-hcp-cluster-g9ldv2" "resourceGroup"="autoscaling-cluster-lfddg6"
  "ts"="2026-05-14 05:30:00.618320" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-autoscaling-hcp-cluster-g9ldv2" "resourceGroup"=""
  "ts"="2026-05-14 05:30:02.019461" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-31a71a35884d87a4a1de36eceeb324011e1c775154472da33ffc40cde64c08cb.yaml.gz"
  "ts"="2026-05-14 05:30:02.019562" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-31a71a35884d87a4a1de36eceeb324011e1c775154472da33ffc40cde64c08cb.yaml.gz"
  "ts"="2026-05-14 05:30:02.019614" "level"=0 "msg"="collecting debug info"
  "ts"="2026-05-14 05:30:02.021044" "level"=0 "msg"="collecting deployments" "resourceGroup"="autoscaling-cluster-lfddg6"
  "ts"="2026-05-14 05:30:02.021025" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-12"
  "ts"="2026-05-14 05:30:02.340783" "level"=0 "msg"="collecting operations" "resourceGroup"="autoscaling-cluster-lfddg6" "deployment"="pooledNonMsiScopedAssignments-e4ixwyxsfjnje"
  "ts"="2026-05-14 05:30:02.389983" "level"=0 "msg"="collecting operations" "resourceGroup"="autoscaling-cluster-lfddg6" "deployment"="customer-infra-autoscaling-hcp-cluster-g9ldv2"
  "ts"="2026-05-14 05:30:02.843289" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-12" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-05-14 05:30:03.312787" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-12" "deployment"="msi-deployment-12"
  "ts"="2026-05-14 05:30:03.420865" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-05-14 05:30:04.407214" "level"=0 "msg"="deleting created resources"
  "ts"="2026-05-14 05:30:04.407388" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="autoscaling-cluster-lfddg6"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:148]: Unexpected error:
    <*fmt.wrapErrors | 0xc001018bd0>: 
    failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-8xbbww" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-8xbbww, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:148]: Unexpected error:
    <*fmt.wrapErrors | 0xc001018bd0>: 
    failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-8xbbww" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-8xbbww, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009f4b70>: 
    failed to create HCP cluster cluster-candidate-5-0-5v45t6, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-5-0-5v45t6 in resource group rg-candidate-5-0-27vmqc, error: failed waiting for cluster="cluster-candidate-5-0-5v45t6" in resourcegroup="rg-candidate-5-0-27vmqc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-5-0-5v45t6 in resource group rg-candidate-5-0-27vmqc, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009f4b70>: 
    failed to create HCP cluster cluster-candidate-5-0-5v45t6, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-5-0-5v45t6 in resource group rg-candidate-5-0-27vmqc, error: failed waiting for cluster="cluster-candidate-5-0-5v45t6" in resourcegroup="rg-candidate-5-0-27vmqc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-5-0-5v45t6 in resource group rg-candidate-5-0-27vmqc, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc00120a240>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-96mhm6, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-96mhm6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-96mhm6, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc00120a240>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-96mhm6, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-96mhm6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-96mhm6, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc001224930>: 
    failed to create HCP cluster cilium-cl, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-5ggcwh, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-5ggcwh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-5ggcwh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc001224930>: 
    failed to create HCP cluster cilium-cl, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-5ggcwh, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-5ggcwh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-5ggcwh, error: context deadline exceeded
    ...
occurred
Deserializaion Error: no output from command
02:42:27 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite prod/parallel
Show raw failure
remaining specs.  Interrupt again to skip cleanup.
    Here's a current progress report:
      Customer should be able to create node pools with ARM64-based VMs (Spec Runtime: 2h29m59.866s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35
        In [It] (Node Runtime: 2h29m59.866s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35
          At [By Step] creating the HCP cluster (Step Runtime: 13m47.243s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:82

          Spec Goroutine
          goroutine 68 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8e29e48, 0xc0002211d0}, 0x82faaf2?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8e66d20, {0x8e29e48, 0xc0002211d0}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8e29eb8?, 0xc00059c000?}, {{0x8e42958?, 0xc000e5de00?}, 0xc000e2f1d0?}, 0xc00008f768, {0xc0015403a8, 0x17}, {0x8325b3f, 0x14}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:852
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc0012fb230, 0x7}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:346
          > github.com/Azure/ARO-HCP/test/e2e.init.func4.2({0x7f50c840d880, 0xc000d3a480})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:83
                | 
                | By("creating the HCP cluster")
                > err = tc.CreateHCPClusterFromParam(
                | 	ctx,
                | 	GinkgoLogr,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8e42a30?, 0xc000d3a480?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 100
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90 @ 05/14/26 05:30:00.521
  "ts"="2026-05-14 05:30:00.521490" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-05-14 05:30:00.521588" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-arm64-vm-hcp-cluster-g28xxb" "resourceGroup"="arm64-vm-cluster-5c9nb2"
  "ts"="2026-05-14 05:30:00.632760" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-arm64-vm-hcp-cluster-g28xxb" "resourceGroup"=""
  "ts"="2026-05-14 05:30:01.028526" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz"
  "ts"="2026-05-14 05:30:01.028613" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz"
  "ts"="2026-05-14 05:30:01.028662" "level"=0 "msg"="collecting debug info"
  "ts"="2026-05-14 05:30:01.030090" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-61"
  "ts"="2026-05-14 05:30:01.030091" "level"=0 "msg"="collecting deployments" "resourceGroup"="arm64-vm-cluster-5c9nb2"
  "ts"="2026-05-14 05:30:01.333150" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-61" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-05-14 05:30:01.402843" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-5c9nb2" "deployment"="pooledNonMsiScopedAssignments-6htyoibevj7ye"
  "ts"="2026-05-14 05:30:01.445386" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-61" "deployment"="msi-deployment-61"
  "ts"="2026-05-14 05:30:01.468401" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-5c9nb2" "deployment"="customer-infra-arm64-vm-hcp-cluster-g28xxb"
  "ts"="2026-05-14 05:30:01.574116" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-05-14 05:30:01.760665" "level"=0 "msg"="deleting created resources"
  "ts"="2026-05-14 05:30:01.763535" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="arm64-vm-cluster-5c9nb2"
Command Error: signal: killed
Deserializaion Error: no output from command
remaining specs.  Interrupt again to skip cleanup.
    Here's a current progress report:
      Customer should be able to create node pools with ARM64-based VMs (Spec Runtime: 2h29m59.866s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35
        In [It] (Node Runtime: 2h29m59.866s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35
          At [By Step] creating the HCP cluster (Step Runtime: 13m47.243s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:82

          Spec Goroutine
          goroutine 68 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8e29e48, 0xc0002211d0}, 0x82faaf2?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8e66d20, {0x8e29e48, 0xc0002211d0}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8e29eb8?, 0xc00059c000?}, {{0x8e42958?, 0xc000e5de00?}, 0xc000e2f1d0?}, 0xc00008f768, {0xc0015403a8, 0x17}, {0x8325b3f, 0x14}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:852
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc0012fb230, 0x7}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:346
          > github.com/Azure/ARO-HCP/test/e2e.init.func4.2({0x7f50c840d880, 0xc000d3a480})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:83
                | 
                | By("creating the HCP cluster")
                > err = tc.CreateHCPClusterFromParam(
                | 	ctx,
                | 	GinkgoLogr,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8e42a30?, 0xc000d3a480?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 100
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90 @ 05/14/26 05:30:00.521
  "ts"="2026-05-14 05:30:00.521490" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-05-14 05:30:00.521588" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-arm64-vm-hcp-cluster-g28xxb" "resourceGroup"="arm64-vm-cluster-5c9nb2"
  "ts"="2026-05-14 05:30:00.632760" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-arm64-vm-hcp-cluster-g28xxb" "resourceGroup"=""
  "ts"="2026-05-14 05:30:01.028526" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz"
  "ts"="2026-05-14 05:30:01.028613" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz"
  "ts"="2026-05-14 05:30:01.028662" "level"=0 "msg"="collecting debug info"
  "ts"="2026-05-14 05:30:01.030090" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-61"
  "ts"="2026-05-14 05:30:01.030091" "level"=0 "msg"="collecting deployments" "resourceGroup"="arm64-vm-cluster-5c9nb2"
  "ts"="2026-05-14 05:30:01.333150" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-61" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-05-14 05:30:01.402843" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-5c9nb2" "deployment"="pooledNonMsiScopedAssignments-6htyoibevj7ye"
  "ts"="2026-05-14 05:30:01.445386" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-61" "deployment"="msi-deployment-61"
  "ts"="2026-05-14 05:30:01.468401" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-5c9nb2" "deployment"="customer-infra-arm64-vm-hcp-cluster-g28xxb"
  "ts"="2026-05-14 05:30:01.574116" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-05-14 05:30:01.760665" "level"=0 "msg"="deleting created resources"
  "ts"="2026-05-14 05:30:01.763535" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="arm64-vm-cluster-5c9nb2"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:112]: Unexpected error:
    <*fmt.wrapErrors | 0xc001479500>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-h9mp9h, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-h9mp9h" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-h9mp9h, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:112]: Unexpected error:
    <*fmt.wrapErrors | 0xc001479500>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-h9mp9h, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-h9mp9h" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-h9mp9h, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014005d0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-msrtlg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-msrtlg, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014005d0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-msrtlg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-msrtlg, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:130]: Unexpected error:
    <*fmt.wrapErrors | 0xc00093e510>: 
    failed to create HCP cluster np-version-upgrade-cluster-6pwlsp, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-6pwlsp in resource group rg-np-version-upgrade-6pwlsp-j49x8t, error: failed waiting for cluster="np-version-upgrade-cluster-6pwlsp" in resourcegroup="rg-np-version-upgrade-6pwlsp-j49x8t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-6pwlsp in resource group rg-np-version-upgrade-6pwlsp-j49x8t, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:130]: Unexpected error:
    <*fmt.wrapErrors | 0xc00093e510>: 
    failed to create HCP cluster np-version-upgrade-cluster-6pwlsp, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-6pwlsp in resource group rg-np-version-upgrade-6pwlsp-j49x8t, error: failed waiting for cluster="np-version-upgrade-cluster-6pwlsp" in resourcegroup="rg-np-version-upgrade-6pwlsp-j49x8t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-6pwlsp in resource group rg-np-version-upgrade-6pwlsp-j49x8t, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fd0ab0>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-zxzmbb, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-zxzmbb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-zxzmbb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fd0ab0>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-zxzmbb, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-zxzmbb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-zxzmbb, error: context deadline exceeded
    ...
occurred
Deserializaion Error: no output from command
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite prod/parallel
Show raw failure
Customer should be able to create an HCP cluster and custom node pool osDisk size (Spec Runtime: 2h29m59.889s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:35
        In [It] (Node Runtime: 2h29m59.889s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:35
          At [By Step] creating the HCP cluster (Step Runtime: 13m58.338s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:73

          Spec Goroutine
          goroutine 76 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8e29e48, 0xc0013e8690}, 0x82faaf2?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8e66d20, {0x8e29e48, 0xc0013e8690}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8e29eb8?, 0xc0014043f0?}, {{0x8e42958?, 0xc000d9c600?}, 0xc000798b30?}, 0xc00008f760, {0xc000080990, 0x13}, {0x8319ec1, 0x12}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:852
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc0013f6c97, 0x7}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:346
          > github.com/Azure/ARO-HCP/test/e2e.init.func9.2({0x7fdc50f03d38, 0xc000baa1e0})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:74
                | 
                | By("creating the HCP cluster")
                > err = tc.CreateHCPClusterFromParam(ctx,
                | 	GinkgoLogr,
                | 	*resourceGroup.Name,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8e42a30?, 0xc000baa1e0?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 96
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80 @ 05/14/26 05:30:00.526
  "ts"="2026-05-14 05:30:00.526801" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-05-14 05:30:00.526855" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-hcp-cluster-np-128-xgjwjl" "resourceGroup"="clusternp128-dw5kpk"
  "ts"="2026-05-14 05:30:00.645848" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-hcp-cluster-np-128-xgjwjl" "resourceGroup"=""
  "ts"="2026-05-14 05:30:00.988854" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-a85d76e69c62fcc4973899bcc5957cf5e02900c7383d8dbab637c1fde0fca561.yaml.gz"
  "ts"="2026-05-14 05:30:00.988958" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-a85d76e69c62fcc4973899bcc5957cf5e02900c7383d8dbab637c1fde0fca561.yaml.gz"
  "ts"="2026-05-14 05:30:00.989012" "level"=0 "msg"="collecting debug info"
  "ts"="2026-05-14 05:30:00.991791" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-16"
  "ts"="2026-05-14 05:30:00.991804" "level"=0 "msg"="collecting deployments" "resourceGroup"="clusternp128-dw5kpk"
  "ts"="2026-05-14 05:30:01.307927" "level"=0 "msg"="collecting operations" "resourceGroup"="clusternp128-dw5kpk" "deployment"="pooledNonMsiScopedAssignments-3ljyjjx2n7gxo"
  "ts"="2026-05-14 05:30:01.324197" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-16" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-05-14 05:30:01.368575" "level"=0 "msg"="collecting operations" "resourceGroup"="clusternp128-dw5kpk" "deployment"="customer-infra-hcp-cluster-np-128-xgjwjl"
  "ts"="2026-05-14 05:30:01.445985" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-16" "deployment"="msi-deployment-16"
  "ts"="2026-05-14 05:30:01.570429" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-05-14 05:30:01.771943" "level"=0 "msg"="deleting created resources"
  "ts"="2026-05-14 05:30:01.772204" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="clusternp128-dw5kpk"
Command Error: signal: killed
Deserializaion Error: no output from command
Customer should be able to create an HCP cluster and custom node pool osDisk size (Spec Runtime: 2h29m59.889s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:35
        In [It] (Node Runtime: 2h29m59.889s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:35
          At [By Step] creating the HCP cluster (Step Runtime: 13m58.338s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:73

          Spec Goroutine
          goroutine 76 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8e29e48, 0xc0013e8690}, 0x82faaf2?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8e66d20, {0x8e29e48, 0xc0013e8690}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8e29eb8?, 0xc0014043f0?}, {{0x8e42958?, 0xc000d9c600?}, 0xc000798b30?}, 0xc00008f760, {0xc000080990, 0x13}, {0x8319ec1, 0x12}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:852
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc0013f6c97, 0x7}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:346
          > github.com/Azure/ARO-HCP/test/e2e.init.func9.2({0x7fdc50f03d38, 0xc000baa1e0})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:74
                | 
                | By("creating the HCP cluster")
                > err = tc.CreateHCPClusterFromParam(ctx,
                | 	GinkgoLogr,
                | 	*resourceGroup.Name,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8e42a30?, 0xc000baa1e0?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 96
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80 @ 05/14/26 05:30:00.526
  "ts"="2026-05-14 05:30:00.526801" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-05-14 05:30:00.526855" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-hcp-cluster-np-128-xgjwjl" "resourceGroup"="clusternp128-dw5kpk"
  "ts"="2026-05-14 05:30:00.645848" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-hcp-cluster-np-128-xgjwjl" "resourceGroup"=""
  "ts"="2026-05-14 05:30:00.988854" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-a85d76e69c62fcc4973899bcc5957cf5e02900c7383d8dbab637c1fde0fca561.yaml.gz"
  "ts"="2026-05-14 05:30:00.988958" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-a85d76e69c62fcc4973899bcc5957cf5e02900c7383d8dbab637c1fde0fca561.yaml.gz"
  "ts"="2026-05-14 05:30:00.989012" "level"=0 "msg"="collecting debug info"
  "ts"="2026-05-14 05:30:00.991791" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-16"
  "ts"="2026-05-14 05:30:00.991804" "level"=0 "msg"="collecting deployments" "resourceGroup"="clusternp128-dw5kpk"
  "ts"="2026-05-14 05:30:01.307927" "level"=0 "msg"="collecting operations" "resourceGroup"="clusternp128-dw5kpk" "deployment"="pooledNonMsiScopedAssignments-3ljyjjx2n7gxo"
  "ts"="2026-05-14 05:30:01.324197" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-16" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-05-14 05:30:01.368575" "level"=0 "msg"="collecting operations" "resourceGroup"="clusternp128-dw5kpk" "deployment"="customer-infra-hcp-cluster-np-128-xgjwjl"
  "ts"="2026-05-14 05:30:01.445985" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-16" "deployment"="msi-deployment-16"
  "ts"="2026-05-14 05:30:01.570429" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-05-14 05:30:01.771943" "level"=0 "msg"="deleting created resources"
  "ts"="2026-05-14 05:30:01.772204" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="clusternp128-dw5kpk"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc001edd3b0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-847fsz, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-847fsz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-847fsz, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc001edd3b0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-847fsz, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-847fsz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-847fsz, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:134]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d656b0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-wggmfn, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-wggmfn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-wggmfn, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:134]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d656b0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-wggmfn, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-wggmfn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-wggmfn, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009b8f90>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-jz8z94, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-jz8z94" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-jz8z94, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009b8f90>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-jz8z94, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-jz8z94" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-jz8z94, error: context deadline exceeded
    ...
occurred
Cluster should become ready within 45 minutes
02:42:27 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 2700.007s.
Cluster should become ready within 45 minutes
Expected
    <bool>: ...
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 2700.007s.
Cluster should become ready within 45 minutes
Expected
    <bool>: ...
to be true
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc001436630>: 
    failed to create HCP cluster cluster-candidate-4-21-g9w68r, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-21-g9w68r in resource group rg-candidate-4-21-hk4wmf, error: failed waiting for cluster="cluster-candidate-4-21-g9w68r" in resourcegroup="rg-candidate-4-21-hk4wmf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-21-g9w68r in resource group rg-candidate-4-21-hk4wmf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc001436630>: 
    failed to create HCP cluster cluster-candidate-4-21-g9w68r, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-21-g9w68r in resource group rg-candidate-4-21-hk4wmf, error: failed waiting for cluster="cluster-candidate-4-21-g9w68r" in resourcegroup="rg-candidate-4-21-hk4wmf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-candidate-4-21-g9w68r in resource group rg-candidate-4-21-hk4wmf, error: context deadline exceeded
    ...
occurred
context deadline exceeded
02:42:27 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:132]: Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:132]: Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:42:27 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc001302cf0>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-clrllm, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-clrllm" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-clrllm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc001302cf0>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-clrllm, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-clrllm" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-clrllm, error: context deadline exceeded
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a