<
Single Day: Jun 12
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 8
e2e (8)
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-b2wkml" for cluster "cluster-nightly-4-20-b2wkml"
Unexpected error:
    <*fmt.wrapErrors | 0xc00113d440>: 
    failed to create NodePool np-b2wkml, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-b2wkml in resource group rg-nightly-4-20-qbtpg6, error: failed waiting for nodepool="np-b2wkml" for cluster "cluster-nightly-4-20-b2wkml" in resourcegroup="rg-nightly-4-20-qbtpg6" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-b2wkml" for cluster "cluster-nightly-4-20-b2wkml"
Unexpected error:
    <*fmt.wrapErrors | 0xc00113d440>: 
    failed to create NodePool np-b2wkml, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-b2wkml in resource group rg-nightly-4-20-qbtpg6, error: failed waiting for nodepool="np-b2wkml" for cluster "cluster-nightly-4-20-b2wkml" in resourcegroup="rg-nightly-4-20-qbtpg6" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-vp6zbb" for cluster "cluster-nightly-4-21-vp6zbb"
Unexpected error:
    <*fmt.wrapErrors | 0xc00096c810>: 
    failed to create NodePool np-vp6zbb, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-vp6zbb in resource group rg-nightly-4-21-6wf75q, error: failed waiting for nodepool="np-vp6zbb" for cluster "cluster-nightly-4-21-vp6zbb" in resourcegroup="rg-nightly-4-21-6wf75q" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-vp6zbb" for cluster "cluster-nightly-4-21-vp6zbb"
Unexpected error:
    <*fmt.wrapErrors | 0xc00096c810>: 
    failed to create NodePool np-vp6zbb, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-vp6zbb in resource group rg-nightly-4-21-6wf75q, error: failed waiting for nodepool="np-vp6zbb" for cluster "cluster-nightly-4-21-vp6zbb" in resourcegroup="rg-nightly-4-21-6wf75q" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:08 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00071c960>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-nbvcvf, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-nbvcvf" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00071c960>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-nbvcvf, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-nbvcvf" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-pvnhvs/cluster-nightly-5-0-d4j2sj should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0013724b0>: 
    failed waiting for cluster="cluster-nightly-5-0-d4j2sj" in resourcegroup="rg-nightly-5-0-pvnhvs" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-d4j2sj in resource group rg-nightly-5-0-pvnhvs, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-pvnhvs/cluster-nightly-5-0-d4j2sj should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0013724b0>: 
    failed waiting for cluster="cluster-nightly-5-0-d4j2sj" in resourcegroup="rg-nightly-5-0-pvnhvs" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-d4j2sj in resource group rg-nightly-5-0-pvnhvs, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:08 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc000c80930>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-n9rvxv, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-n9rvxv" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc000c80930>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-n9rvxv, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-n9rvxv" to finish creating: context deadline exceeded
    ...
occurred
ERROR CODE: InvalidTemplateDeployment; provider Microsoft.Compute
23:00:08 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:130]: failed to deploy test VM
Unexpected error:
    <*fmt.wrapError | 0xc0013d1a20>: 
    failed creating deployment "test-vm" in resourcegroup="e2e-cidr-connectivity-2sjgbz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/e2e-cidr-connectivity-2sjgbz/providers/Microsoft.Resources/deployments/test-vm
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidTemplateDeployment
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidTemplateDeployment",
        "message": "The template deployment 'test-vm' is not valid according to the validation procedure. The following resource provider(s) - 'Microsoft.Compute/virtualMachines (2023-03-01)' reported preflight validation errors. Tracking id is 'b2c99696-6a64-4f4d-b754-5215e88212fd'. See inner errors for details.",
        "details": [
          {
            "code": "QuotaExceeded",
            "message": "Operation could not be completed as it results in exceeding approved standardDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: uksouth, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22uksouth%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:130]: failed to deploy test VM
Unexpected error:
    <*fmt.wrapError | 0xc0013d1a20>: 
    failed creating deployment "test-vm" in resourcegroup="e2e-cidr-connectivity-2sjgbz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/e2e-cidr-connectivity-2sjgbz/providers/Microsoft.Resources/deployments/test-vm
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidTemplateDeployment
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidTemplateDeployment",
        "message": "The template deployment 'test-vm' is not valid according to the validation procedure. The following resource provider(s) - 'Microsoft.Compute/virtualMachines (2023-03-01)' reported preflight validation errors. Tracking id is 'b2c99696-6a64-4f4d-b754-5215e88212fd'. See inner errors for details.",
        "details": [
          {
            "code": "QuotaExceeded",
            "message": "Operation could not be completed as it results in exceeding approved standardDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: uksouth, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22uksouth%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-tn55hn" for cluster "cluster-nightly-4-22-tn55hn"
Unexpected error:
    <*fmt.wrapErrors | 0xc000dacea0>: 
    failed to create NodePool np-tn55hn, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-tn55hn in resource group rg-nightly-4-22-wnk5fg, error: failed waiting for nodepool="np-tn55hn" for cluster "cluster-nightly-4-22-tn55hn" in resourcegroup="rg-nightly-4-22-wnk5fg" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-tn55hn" for cluster "cluster-nightly-4-22-tn55hn"
Unexpected error:
    <*fmt.wrapErrors | 0xc000dacea0>: 
    failed to create NodePool np-tn55hn, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-tn55hn in resource group rg-nightly-4-22-wnk5fg, error: failed waiting for nodepool="np-tn55hn" for cluster "cluster-nightly-4-22-tn55hn" in resourcegroup="rg-nightly-4-22-wnk5fg" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:08 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-vxlgxp/cluster-nightly-4-23-4q8x4x should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc00052d710>: 
    failed waiting for cluster="cluster-nightly-4-23-4q8x4x" in resourcegroup="rg-nightly-4-23-vxlgxp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-4q8x4x in resource group rg-nightly-4-23-vxlgxp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-vxlgxp/cluster-nightly-4-23-4q8x4x should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc00052d710>: 
    failed waiting for cluster="cluster-nightly-4-23-4q8x4x" in resourcegroup="rg-nightly-4-23-vxlgxp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-4q8x4x in resource group rg-nightly-4-23-vxlgxp, error: context deadline exceeded
    ...
occurred
branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 46
e2e (46)
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0023b8300>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-n66czp, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-n66czp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-n66czp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0023b8300>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-n66czp, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-n66czp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-n66czp, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc0009f6480>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-qcmsvr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-qcmsvr, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc0009f6480>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-qcmsvr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-qcmsvr, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:596]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00172ca20>: 
    failed to create HCP cluster np-downgrade-m2fcsc, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-m2fcsc in resource group rg-np-downgrade-m2fcsc-lhjgqs, error: failed waiting for cluster="np-downgrade-m2fcsc" in resourcegroup="rg-np-downgrade-m2fcsc-lhjgqs" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-m2fcsc in resource group rg-np-downgrade-m2fcsc-lhjgqs, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:596]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00172ca20>: 
    failed to create HCP cluster np-downgrade-m2fcsc, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-m2fcsc in resource group rg-np-downgrade-m2fcsc-lhjgqs, error: failed waiting for cluster="np-downgrade-m2fcsc" in resourcegroup="rg-np-downgrade-m2fcsc-lhjgqs" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-m2fcsc in resource group rg-np-downgrade-m2fcsc-lhjgqs, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-21-wvcsl9" with version 4.21.0-rc.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0007faa80>: 
    failed to create HCP cluster cluster-zstream-4-21-wvcsl9, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-wvcsl9 in resource group rg-zstream-upgrade-4-21-pnd49g, error: failed waiting for cluster="cluster-zstream-4-21-wvcsl9" in resourcegroup="rg-zstream-upgrade-4-21-pnd49g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-wvcsl9 in resource group rg-zstream-upgrade-4-21-pnd49g, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-21-wvcsl9" with version 4.21.0-rc.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0007faa80>: 
    failed to create HCP cluster cluster-zstream-4-21-wvcsl9, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-wvcsl9 in resource group rg-zstream-upgrade-4-21-pnd49g, error: failed waiting for cluster="cluster-zstream-4-21-wvcsl9" in resourcegroup="rg-zstream-upgrade-4-21-pnd49g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-wvcsl9 in resource group rg-zstream-upgrade-4-21-pnd49g, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapErrors | 0xc000e32060>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-4gjwjq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-4gjwjq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapErrors | 0xc000e32060>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-4gjwjq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-4gjwjq, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test MISE Routing routes to the correct frontend based on version header MISE v2 when x-ms-mise-version header is set · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000ba8570>: 
    failed waiting for cluster="mise-routing" in resourcegroup="mise-v2-smoke-tkrfkl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-v2-smoke-tkrfkl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000ba8570>: 
    failed waiting for cluster="mise-routing" in resourcegroup="mise-v2-smoke-tkrfkl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-v2-smoke-tkrfkl, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00158a0c0>: 
    failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-kbffd9, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-kbffd9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-kbffd9, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00158a0c0>: 
    failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-kbffd9, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-kbffd9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-kbffd9, error: context deadline exceeded
    ...
occurred
Cluster should become ready within '20.000000' minutes
19:09:18 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.006s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.006s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:266]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000e10b70>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tpmfns, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-tpmfns" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tpmfns, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:266]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000e10b70>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tpmfns, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-tpmfns" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tpmfns, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test MISE Routing routes to the correct frontend based on version header default route returns no version header · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001292630>: 
    failed waiting for cluster="mise-routing" in resourcegroup="mise-default-smoke-hzkhrd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-default-smoke-hzkhrd, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001292630>: 
    failed waiting for cluster="mise-routing" in resourcegroup="mise-default-smoke-hzkhrd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-default-smoke-hzkhrd, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128"
Unexpected error:
    <*fmt.wrapErrors | 0xc0009ee780>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-5h2jxj, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-5h2jxj" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-5h2jxj, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128"
Unexpected error:
    <*fmt.wrapErrors | 0xc0009ee780>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-5h2jxj, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-5h2jxj" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-5h2jxj, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-22-hnclsh/cluster-candidate-4-22-clwt7j should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a12450>: 
    failed to create HCP cluster cluster-candidate-4-22-clwt7j, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-clwt7j in resource group rg-candidate-4-22-hnclsh, error: failed waiting for cluster="cluster-candidate-4-22-clwt7j" in resourcegroup="rg-candidate-4-22-hnclsh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-clwt7j in resource group rg-candidate-4-22-hnclsh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-22-hnclsh/cluster-candidate-4-22-clwt7j should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a12450>: 
    failed to create HCP cluster cluster-candidate-4-22-clwt7j, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-clwt7j in resource group rg-candidate-4-22-hnclsh, error: failed waiting for cluster="cluster-candidate-4-22-clwt7j" in resourcegroup="rg-candidate-4-22-hnclsh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-clwt7j in resource group rg-candidate-4-22-hnclsh, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-fm8fjn with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc00050e090>: 
    failed to create HCP cluster np-version-upgrade-cluster-fm8fjn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fm8fjn in resource group rg-np-version-upgrade-fm8fjn-85bn48, error: failed waiting for cluster="np-version-upgrade-cluster-fm8fjn" in resourcegroup="rg-np-version-upgrade-fm8fjn-85bn48" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fm8fjn in resource group rg-np-version-upgrade-fm8fjn-85bn48, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-fm8fjn with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc00050e090>: 
    failed to create HCP cluster np-version-upgrade-cluster-fm8fjn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fm8fjn in resource group rg-np-version-upgrade-fm8fjn-85bn48, error: failed waiting for cluster="np-version-upgrade-cluster-fm8fjn" in resourcegroup="rg-np-version-upgrade-fm8fjn-85bn48" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fm8fjn in resource group rg-np-version-upgrade-fm8fjn-85bn48, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: failed to create HCP cluster for pull secret test
Unexpected error:
    <*fmt.wrapErrors | 0xc000f9d7d0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-tr7lqt, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-tr7lqt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-tr7lqt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: failed to create HCP cluster for pull secret test
Unexpected error:
    <*fmt.wrapErrors | 0xc000f9d7d0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-tr7lqt, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-tr7lqt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-tr7lqt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-5nppcz
Unexpected error:
    <*fmt.wrapErrors | 0xc000fe6b10>: 
    failed to create HCP cluster np-noedge-5nppcz, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-5nppcz in resource group rg-np-noedge-5nppcz-bvm4mg, error: failed waiting for cluster="np-noedge-5nppcz" in resourcegroup="rg-np-noedge-5nppcz-bvm4mg" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-5nppcz in resource group rg-np-noedge-5nppcz-bvm4mg, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-5nppcz
Unexpected error:
    <*fmt.wrapErrors | 0xc000fe6b10>: 
    failed to create HCP cluster np-noedge-5nppcz, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-5nppcz in resource group rg-np-noedge-5nppcz-bvm4mg, error: failed waiting for cluster="np-noedge-5nppcz" in resourcegroup="rg-np-noedge-5nppcz-bvm4mg" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-5nppcz in resource group rg-np-noedge-5nppcz-bvm4mg, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled
Unexpected error:
    <*fmt.wrapErrors | 0xc00004c690>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-tvhq6l, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-tvhq6l" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-tvhq6l, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled
Unexpected error:
    <*fmt.wrapErrors | 0xc00004c690>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-tvhq6l, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-tvhq6l" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-tvhq6l, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints
Unexpected error:
    <*fmt.wrapErrors | 0xc00135a9c0>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-78qs75, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-78qs75" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-78qs75, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints
Unexpected error:
    <*fmt.wrapErrors | 0xc00135a9c0>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-78qs75, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-78qs75" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-78qs75, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00084fa10>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-dg98qh, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-dg98qh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-dg98qh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00084fa10>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-dg98qh, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-dg98qh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-dg98qh, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-fg7nd4 with version 4.20.25
Unexpected error:
    <*fmt.wrapErrors | 0xc001a00300>: 
    failed to create HCP cluster np-version-upgrade-cluster-fg7nd4, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fg7nd4 in resource group rg-np-version-upgrade-fg7nd4-4dk6ns, error: failed waiting for cluster="np-version-upgrade-cluster-fg7nd4" in resourcegroup="rg-np-version-upgrade-fg7nd4-4dk6ns" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fg7nd4 in resource group rg-np-version-upgrade-fg7nd4-4dk6ns, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-fg7nd4 with version 4.20.25
Unexpected error:
    <*fmt.wrapErrors | 0xc001a00300>: 
    failed to create HCP cluster np-version-upgrade-cluster-fg7nd4, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fg7nd4 in resource group rg-np-version-upgrade-fg7nd4-4dk6ns, error: failed waiting for cluster="np-version-upgrade-cluster-fg7nd4" in resourcegroup="rg-np-version-upgrade-fg7nd4-4dk6ns" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fg7nd4 in resource group rg-np-version-upgrade-fg7nd4-4dk6ns, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-hfpz7q/cluster-nightly-4-23-24lkwt should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0014e2ed0>: 
    failed waiting for cluster="cluster-nightly-4-23-24lkwt" in resourcegroup="rg-nightly-4-23-hfpz7q" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-24lkwt in resource group rg-nightly-4-23-hfpz7q, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-hfpz7q/cluster-nightly-4-23-24lkwt should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0014e2ed0>: 
    failed waiting for cluster="cluster-nightly-4-23-24lkwt" in resourcegroup="rg-nightly-4-23-hfpz7q" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-24lkwt in resource group rg-nightly-4-23-hfpz7q, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:466]: failed to create HCP cluster np-skip-minor-wztksv at version 4.22.0
Unexpected error:
    <*fmt.wrapErrors | 0xc0004da660>: 
    failed to create HCP cluster np-skip-minor-wztksv, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-wztksv in resource group rg-np-skip-minor-wztksv-g6gkdb, error: failed waiting for cluster="np-skip-minor-wztksv" in resourcegroup="rg-np-skip-minor-wztksv-g6gkdb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-wztksv in resource group rg-np-skip-minor-wztksv-g6gkdb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:466]: failed to create HCP cluster np-skip-minor-wztksv at version 4.22.0
Unexpected error:
    <*fmt.wrapErrors | 0xc0004da660>: 
    failed to create HCP cluster np-skip-minor-wztksv, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-wztksv in resource group rg-np-skip-minor-wztksv-g6gkdb, error: failed waiting for cluster="np-skip-minor-wztksv" in resourcegroup="rg-np-skip-minor-wztksv-g6gkdb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-wztksv in resource group rg-np-skip-minor-wztksv-g6gkdb, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test
Unexpected error:
    <*fmt.wrapErrors | 0xc001386f60>: 
    failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-b84f56, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-b84f56" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-b84f56, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test
Unexpected error:
    <*fmt.wrapErrors | 0xc001386f60>: 
    failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-b84f56, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-b84f56" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-b84f56, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-zvlsqt with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc0015b2b10>: 
    failed to create HCP cluster np-version-upgrade-cluster-zvlsqt, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zvlsqt in resource group rg-np-version-upgrade-zvlsqt-lrp5cd, error: failed waiting for cluster="np-version-upgrade-cluster-zvlsqt" in resourcegroup="rg-np-version-upgrade-zvlsqt-lrp5cd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zvlsqt in resource group rg-np-version-upgrade-zvlsqt-lrp5cd, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-zvlsqt with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc0015b2b10>: 
    failed to create HCP cluster np-version-upgrade-cluster-zvlsqt, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zvlsqt in resource group rg-np-version-upgrade-zvlsqt-lrp5cd, error: failed waiting for cluster="np-version-upgrade-cluster-zvlsqt" in resourcegroup="rg-np-version-upgrade-zvlsqt-lrp5cd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zvlsqt in resource group rg-np-version-upgrade-zvlsqt-lrp5cd, error: context deadline exceeded
    ...
occurred
Interrupted by User
19:09:18 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:30]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:30]: Interrupted by User
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-vf8jgt/cluster-nightly-5-0-dpncp6 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0010cf110>: 
    failed waiting for cluster="cluster-nightly-5-0-dpncp6" in resourcegroup="rg-nightly-5-0-vf8jgt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-dpncp6 in resource group rg-nightly-5-0-vf8jgt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-vf8jgt/cluster-nightly-5-0-dpncp6 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0010cf110>: 
    failed waiting for cluster="cluster-nightly-5-0-dpncp6" in resourcegroup="rg-nightly-5-0-vf8jgt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-dpncp6 in resource group rg-nightly-5-0-vf8jgt, error: context deadline exceeded
    ...
occurred
cluster has not yet reached Succeeded state
19:09:18 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.004s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.004s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159]: failed to create HCP cluster for patch-tags test
Unexpected error:
    <*fmt.wrapErrors | 0xc001459110>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-zcq4zn, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-zcq4zn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-zcq4zn, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159]: failed to create HCP cluster for patch-tags test
Unexpected error:
    <*fmt.wrapErrors | 0xc001459110>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-zcq4zn, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-zcq4zn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-zcq4zn, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test
Unexpected error:
    <*fmt.wrapErrors | 0xc00159cab0>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-9d44bt, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-9d44bt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-9d44bt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test
Unexpected error:
    <*fmt.wrapErrors | 0xc00159cab0>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-9d44bt, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-9d44bt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-9d44bt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc0013eecf0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-d6tck5, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-d6tck5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-d6tck5, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc0013eecf0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-d6tck5, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-d6tck5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-d6tck5, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00129b080>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-5sdvs4, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-5sdvs4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-5sdvs4, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00129b080>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-5sdvs4, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-5sdvs4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-5sdvs4, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:83]: failed to create HCP cluster for external auth list test
Unexpected error:
    <*fmt.wrapErrors | 0xc001646630>: 
    failed to create HCP cluster ea-list9szlkf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9szlkf in resource group ea-list-89xtr6, error: failed waiting for cluster="ea-list9szlkf" in resourcegroup="ea-list-89xtr6" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9szlkf in resource group ea-list-89xtr6, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:83]: failed to create HCP cluster for external auth list test
Unexpected error:
    <*fmt.wrapErrors | 0xc001646630>: 
    failed to create HCP cluster ea-list9szlkf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9szlkf in resource group ea-list-89xtr6, error: failed waiting for cluster="ea-list9szlkf" in resourcegroup="ea-list-89xtr6" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9szlkf in resource group ea-list-89xtr6, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc00105d2f0>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-59sh7b, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-59sh7b" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-59sh7b, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc00105d2f0>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-59sh7b, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-59sh7b" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-59sh7b, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000deb380>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-wzm4mn, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-wzm4mn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-wzm4mn, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000deb380>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-wzm4mn, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-wzm4mn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-wzm4mn, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000808d80>: 
    failed to create HCP cluster np-dg-minor-v76vz8, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-v76vz8 in resource group rg-np-dg-minor-v76vz8-sfdnqs, error: failed waiting for cluster="np-dg-minor-v76vz8" in resourcegroup="rg-np-dg-minor-v76vz8-sfdnqs" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-v76vz8 in resource group rg-np-dg-minor-v76vz8-sfdnqs, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000808d80>: 
    failed to create HCP cluster np-dg-minor-v76vz8, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-v76vz8 in resource group rg-np-dg-minor-v76vz8-sfdnqs, error: failed waiting for cluster="np-dg-minor-v76vz8" in resourcegroup="rg-np-dg-minor-v76vz8-sfdnqs" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-v76vz8 in resource group rg-np-dg-minor-v76vz8-sfdnqs, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:89]: failed to create HCP cluster "arm64-vm-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001658750>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nhfsnw, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-nhfsnw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nhfsnw, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:89]: failed to create HCP cluster "arm64-vm-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001658750>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nhfsnw, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-nhfsnw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nhfsnw, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-22-75nhkq" with version 4.22.0-rc.4 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000f6e930>: 
    failed to create HCP cluster cluster-zstream-4-22-75nhkq, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-75nhkq in resource group rg-zstream-upgrade-4-22-xlwmlt, error: failed waiting for cluster="cluster-zstream-4-22-75nhkq" in resourcegroup="rg-zstream-upgrade-4-22-xlwmlt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-75nhkq in resource group rg-zstream-upgrade-4-22-xlwmlt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-22-75nhkq" with version 4.22.0-rc.4 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000f6e930>: 
    failed to create HCP cluster cluster-zstream-4-22-75nhkq, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-75nhkq in resource group rg-zstream-upgrade-4-22-xlwmlt, error: failed waiting for cluster="cluster-zstream-4-22-75nhkq" in resourcegroup="rg-zstream-upgrade-4-22-xlwmlt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-75nhkq in resource group rg-zstream-upgrade-4-22-xlwmlt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk
Unexpected error:
    <*fmt.wrapErrors | 0xc0012da0c0>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-2fsn9x, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-2fsn9x" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-2fsn9x, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk
Unexpected error:
    <*fmt.wrapErrors | 0xc0012da0c0>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-2fsn9x, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-2fsn9x" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-2fsn9x, error: context deadline exceeded
    ...
occurred
Interrupted by User
19:09:18 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:207]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:207]: Interrupted by User
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test
Unexpected error:
    <*fmt.wrapErrors | 0xc000810510>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-vn4rjf, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-vn4rjf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-vn4rjf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test
Unexpected error:
    <*fmt.wrapErrors | 0xc000810510>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-vn4rjf, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-vn4rjf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-vn4rjf, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:148]: failed to create HCP cluster version 4.19
Unexpected error:
    <*fmt.wrapErrors | 0xc001002ae0>: 
    failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-sfmdpw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-sfmdpw, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:148]: failed to create HCP cluster version 4.19
Unexpected error:
    <*fmt.wrapErrors | 0xc001002ae0>: 
    failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-sfmdpw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-sfmdpw, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-20-zkzjd9" with version 4.20.24 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0009812f0>: 
    failed to create HCP cluster cluster-zstream-4-20-zkzjd9, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-zkzjd9 in resource group rg-zstream-upgrade-4-20-2sskvz, error: failed waiting for cluster="cluster-zstream-4-20-zkzjd9" in resourcegroup="rg-zstream-upgrade-4-20-2sskvz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-zkzjd9 in resource group rg-zstream-upgrade-4-20-2sskvz, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-20-zkzjd9" with version 4.20.24 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0009812f0>: 
    failed to create HCP cluster cluster-zstream-4-20-zkzjd9, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-zkzjd9 in resource group rg-zstream-upgrade-4-20-2sskvz, error: failed waiting for cluster="cluster-zstream-4-20-zkzjd9" in resourcegroup="rg-zstream-upgrade-4-20-2sskvz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-zkzjd9 in resource group rg-zstream-upgrade-4-20-2sskvz, error: context deadline exceeded
    ...
occurred
failed to wait for first cluster "<cluster>" to complete creation
19:09:18 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation
Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation
Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:282]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit
Unexpected error:
    <*fmt.wrapErrors | 0xc0009ee060>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-lssttt, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-lssttt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-lssttt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:282]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit
Unexpected error:
    <*fmt.wrapErrors | 0xc0009ee060>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-lssttt, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-lssttt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-lssttt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:09:18 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-19-6njgk2" with version 4.19.32 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0007b6840>: 
    failed to create HCP cluster cluster-zstream-4-19-6njgk2, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6njgk2 in resource group rg-zstream-upgrade-4-19-f952h4, error: failed waiting for cluster="cluster-zstream-4-19-6njgk2" in resourcegroup="rg-zstream-upgrade-4-19-f952h4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6njgk2 in resource group rg-zstream-upgrade-4-19-f952h4, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-19-6njgk2" with version 4.19.32 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0007b6840>: 
    failed to create HCP cluster cluster-zstream-4-19-6njgk2, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6njgk2 in resource group rg-zstream-upgrade-4-19-f952h4, error: failed waiting for cluster="cluster-zstream-4-19-6njgk2" in resourcegroup="rg-zstream-upgrade-4-19-f952h4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6njgk2 in resource group rg-zstream-upgrade-4-19-f952h4, error: context deadline exceeded
    ...
occurred
Deserializaion Error: no output from command
19:09:18 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
077e8 sp=0xc000e077e0 pc=0x2ed3cc1
created by os/signal.Notify.func1.1 in goroutine 84
	/usr/lib/golang/src/os/signal/signal.go:152 +0x1f

goroutine 104 gp=0xc000201180 m=nil [runnable]:
runtime.gopark(0xc000e07f88?, 0x3?, 0x0?, 0x0?, 0xc000e07f6a?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000e07df0 sp=0xc000e07dd0 pc=0x2ecb50e
runtime.selectgo(0xc000e07f88, 0xc000e07f64, 0x0?, 0x0, 0xc000000000?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000e07f30 sp=0xc000e07df0 pc=0x2ea62f7
github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts.func2(0xc000efd1e0?)
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:131 +0x7d fp=0xc000e07fc8 sp=0xc000e07f30 pc=0x33174bd
github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts.gowrap1()
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:158 +0x24 fp=0xc000e07fe0 sp=0xc000e07fc8 pc=0x3317404
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e07fe8 sp=0xc000e07fe0 pc=0x2ed3cc1
created by github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts in goroutine 30
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:128 +0x165

goroutine 30 gp=0xc0002016c0 m=nil [select, 149 minutes]:
runtime.gopark(0xc000fa4990?, 0x5?, 0x28?, 0x39?, 0xc000fa3cee?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000fa38f0 sp=0xc000fa38d0 pc=0x2ecb50e
runtime.selectgo(0xc000fa4990, 0xc000fa3ce4, 0x0?, 0x0, 0x0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000fa3a30 sp=0xc000fa38f0 pc=0x2ea62f7
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode(_, {0x4b, 0x4, {0x861dc94, 0x8}, 0xc000e0fb80, {{0xa91353c, 0x5b}, 0xd0, {0x0, ...}, ...}, ...}, ...)
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:923 +0xf65 fp=0xc000fa4d28 sp=0xc000fa3a30 pc=0x33422c5
github.com/onsi/ginkgo/v2/internal.(*group).attemptSpec(0xc000fa6b88, 0x1, {{0xc000ec8e08?, 0xc00070c8c0?, 0x2?}, 0x0?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:199 +0xbd3 fp=0xc000fa5d48 sp=0xc000fa4d28 pc=0x3327713
github.com/onsi/ginkgo/v2/internal.(*group).run(0xc000fa6b88, {0xc000a9e500?, 0x0?, 0x0?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:349 +0x905 fp=0xc000fa6950 sp=0xc000fa5d48 pc=0x3329ca5
github.com/onsi/ginkgo/v2/internal.(*Suite).runSpecs(0xc000a4e008, {0x0, 0x0}, {0xc81b8c0, 0x0, 0x0}, {0xc00007a094, 0x2a}, 0x0, {0xc000a9e4e0, ...})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496 +0xa9b fp=0xc000fa6e00 sp=0xc000fa6950 pc=0x333d79b
github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a094, 0x2a}, ...)
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68 +0x3c5 fp=0xc000fa6ea8 sp=0xc000fa6e00 pc=0x3344b05
github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2e5aa85?, 0xc0002b0240?})
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/ginkgo/util.go:84 +0x2ba fp=0xc000fa7b78 sp=0xc000fa6ea8 pc=0x6f4bb5a
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x91e1708, 0xc000e98ff0}, 0xc000efd1e0, 0x1)
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:596 +0xee fp=0xc000fa7c20 sp=0xc000fa7b78 pc=0x6f41dce
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:237 +0x196 fp=0xc000fa7fe0 sp=0xc000fa7c20 pc=0x6f3db36
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000fa7fe8 sp=0xc000fa7fe0 pc=0x2ed3cc1
created by github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:230 +0x1e5

rax    0xca
rbx    0x0
rcx    0x2ed5ae3
rdx    0x0
rdi    0xc7f0b70
rsi    0x80
rbp    0x7fffd43d8bf0
rsp    0x7fffd43d8ba8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1
r13    0x1
r14    0xc7ee5e0
r15    0x5
rip    0x2ed5ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserializaion Error: no output from command
077e8 sp=0xc000e077e0 pc=0x2ed3cc1
created by os/signal.Notify.func1.1 in goroutine 84
	/usr/lib/golang/src/os/signal/signal.go:152 +0x1f

goroutine 104 gp=0xc000201180 m=nil [runnable]:
runtime.gopark(0xc000e07f88?, 0x3?, 0x0?, 0x0?, 0xc000e07f6a?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000e07df0 sp=0xc000e07dd0 pc=0x2ecb50e
runtime.selectgo(0xc000e07f88, 0xc000e07f64, 0x0?, 0x0, 0xc000000000?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000e07f30 sp=0xc000e07df0 pc=0x2ea62f7
github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts.func2(0xc000efd1e0?)
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:131 +0x7d fp=0xc000e07fc8 sp=0xc000e07f30 pc=0x33174bd
github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts.gowrap1()
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:158 +0x24 fp=0xc000e07fe0 sp=0xc000e07fc8 pc=0x3317404
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e07fe8 sp=0xc000e07fe0 pc=0x2ed3cc1
created by github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts in goroutine 30
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:128 +0x165

goroutine 30 gp=0xc0002016c0 m=nil [select, 149 minutes]:
runtime.gopark(0xc000fa4990?, 0x5?, 0x28?, 0x39?, 0xc000fa3cee?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000fa38f0 sp=0xc000fa38d0 pc=0x2ecb50e
runtime.selectgo(0xc000fa4990, 0xc000fa3ce4, 0x0?, 0x0, 0x0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000fa3a30 sp=0xc000fa38f0 pc=0x2ea62f7
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode(_, {0x4b, 0x4, {0x861dc94, 0x8}, 0xc000e0fb80, {{0xa91353c, 0x5b}, 0xd0, {0x0, ...}, ...}, ...}, ...)
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:923 +0xf65 fp=0xc000fa4d28 sp=0xc000fa3a30 pc=0x33422c5
github.com/onsi/ginkgo/v2/internal.(*group).attemptSpec(0xc000fa6b88, 0x1, {{0xc000ec8e08?, 0xc00070c8c0?, 0x2?}, 0x0?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:199 +0xbd3 fp=0xc000fa5d48 sp=0xc000fa4d28 pc=0x3327713
github.com/onsi/ginkgo/v2/internal.(*group).run(0xc000fa6b88, {0xc000a9e500?, 0x0?, 0x0?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:349 +0x905 fp=0xc000fa6950 sp=0xc000fa5d48 pc=0x3329ca5
github.com/onsi/ginkgo/v2/internal.(*Suite).runSpecs(0xc000a4e008, {0x0, 0x0}, {0xc81b8c0, 0x0, 0x0}, {0xc00007a094, 0x2a}, 0x0, {0xc000a9e4e0, ...})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496 +0xa9b fp=0xc000fa6e00 sp=0xc000fa6950 pc=0x333d79b
github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a094, 0x2a}, ...)
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68 +0x3c5 fp=0xc000fa6ea8 sp=0xc000fa6e00 pc=0x3344b05
github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2e5aa85?, 0xc0002b0240?})
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/ginkgo/util.go:84 +0x2ba fp=0xc000fa7b78 sp=0xc000fa6ea8 pc=0x6f4bb5a
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x91e1708, 0xc000e98ff0}, 0xc000efd1e0, 0x1)
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:596 +0xee fp=0xc000fa7c20 sp=0xc000fa7b78 pc=0x6f41dce
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:237 +0x196 fp=0xc000fa7fe0 sp=0xc000fa7c20 pc=0x6f3db36
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000fa7fe8 sp=0xc000fa7fe0 pc=0x2ed3cc1
created by github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
	/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:230 +0x1e5

rax    0xca
rbx    0x0
rcx    0x2ed5ae3
rdx    0x0
rdi    0xc7f0b70
rsi    0x80
rbp    0x7fffd43d8bf0
rsp    0x7fffd43d8ba8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1
r13    0x1
r14    0xc7ee5e0
r15    0x5
rip    0x2ed5ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserializaion Error: no output from command
Interrupted by User
19:09:18 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:46]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:46]: Interrupted by User
branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 46
e2e (46)
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0010ce720>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-n6pqzv, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-n6pqzv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-n6pqzv, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0010ce720>: 
    failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-n6pqzv, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-n6pqzv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-n6pqzv, error: context deadline exceeded
    ...
occurred
Interrupted by User
10:57:20 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:30]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:30]: Interrupted by User
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test MISE Routing routes to the correct frontend based on version header MISE v2 when x-ms-mise-version header is set · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0010588a0>: 
    failed waiting for cluster="mise-routing" in resourcegroup="mise-v2-smoke-t8zlsl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-v2-smoke-t8zlsl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0010588a0>: 
    failed waiting for cluster="mise-routing" in resourcegroup="mise-v2-smoke-t8zlsl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-v2-smoke-t8zlsl, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapErrors | 0xc0009c4480>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-6n64xn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-6n64xn, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapErrors | 0xc0009c4480>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-6n64xn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-6n64xn, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000a129f0>: 
    failed to create HCP cluster np-dg-minor-wvnwjs, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-wvnwjs in resource group rg-np-dg-minor-wvnwjs-lgf94f, error: failed waiting for cluster="np-dg-minor-wvnwjs" in resourcegroup="rg-np-dg-minor-wvnwjs-lgf94f" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-wvnwjs in resource group rg-np-dg-minor-wvnwjs-lgf94f, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000a129f0>: 
    failed to create HCP cluster np-dg-minor-wvnwjs, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-wvnwjs in resource group rg-np-dg-minor-wvnwjs-lgf94f, error: failed waiting for cluster="np-dg-minor-wvnwjs" in resourcegroup="rg-np-dg-minor-wvnwjs-lgf94f" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-wvnwjs in resource group rg-np-dg-minor-wvnwjs-lgf94f, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:266]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000756630>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tj6wt8, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-tj6wt8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tj6wt8, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:266]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000756630>: 
    failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tj6wt8, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-tj6wt8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-tj6wt8, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-7pxgpd with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc00131eb10>: 
    failed to create HCP cluster np-version-upgrade-cluster-7pxgpd, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-7pxgpd in resource group rg-np-version-upgrade-7pxgpd-fjrdcw, error: failed waiting for cluster="np-version-upgrade-cluster-7pxgpd" in resourcegroup="rg-np-version-upgrade-7pxgpd-fjrdcw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-7pxgpd in resource group rg-np-version-upgrade-7pxgpd-fjrdcw, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-7pxgpd with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc00131eb10>: 
    failed to create HCP cluster np-version-upgrade-cluster-7pxgpd, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-7pxgpd in resource group rg-np-version-upgrade-7pxgpd-fjrdcw, error: failed waiting for cluster="np-version-upgrade-cluster-7pxgpd" in resourcegroup="rg-np-version-upgrade-7pxgpd-fjrdcw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-7pxgpd in resource group rg-np-version-upgrade-7pxgpd-fjrdcw, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-22-mmbw5p/cluster-candidate-4-22-z7g8wz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015d8420>: 
    failed to create HCP cluster cluster-candidate-4-22-z7g8wz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-z7g8wz in resource group rg-candidate-4-22-mmbw5p, error: failed waiting for cluster="cluster-candidate-4-22-z7g8wz" in resourcegroup="rg-candidate-4-22-mmbw5p" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-z7g8wz in resource group rg-candidate-4-22-mmbw5p, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-22-mmbw5p/cluster-candidate-4-22-z7g8wz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0015d8420>: 
    failed to create HCP cluster cluster-candidate-4-22-z7g8wz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-z7g8wz in resource group rg-candidate-4-22-mmbw5p, error: failed waiting for cluster="cluster-candidate-4-22-z7g8wz" in resourcegroup="rg-candidate-4-22-mmbw5p" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-z7g8wz in resource group rg-candidate-4-22-mmbw5p, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:83]: failed to create HCP cluster for external auth list test
Unexpected error:
    <*fmt.wrapErrors | 0xc0006a9350>: 
    failed to create HCP cluster ea-listpxzpkb, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listpxzpkb in resource group ea-list-r7pt9h, error: failed waiting for cluster="ea-listpxzpkb" in resourcegroup="ea-list-r7pt9h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listpxzpkb in resource group ea-list-r7pt9h, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:83]: failed to create HCP cluster for external auth list test
Unexpected error:
    <*fmt.wrapErrors | 0xc0006a9350>: 
    failed to create HCP cluster ea-listpxzpkb, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listpxzpkb in resource group ea-list-r7pt9h, error: failed waiting for cluster="ea-listpxzpkb" in resourcegroup="ea-list-r7pt9h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listpxzpkb in resource group ea-list-r7pt9h, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-qnm2t5/cluster-nightly-5-0-phfxlq should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001900030>: 
    failed waiting for cluster="cluster-nightly-5-0-phfxlq" in resourcegroup="rg-nightly-5-0-qnm2t5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-phfxlq in resource group rg-nightly-5-0-qnm2t5, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-qnm2t5/cluster-nightly-5-0-phfxlq should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001900030>: 
    failed waiting for cluster="cluster-nightly-5-0-phfxlq" in resourcegroup="rg-nightly-5-0-qnm2t5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-phfxlq in resource group rg-nightly-5-0-qnm2t5, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: failed to create HCP cluster for pull secret test
Unexpected error:
    <*fmt.wrapErrors | 0xc00138aab0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t5wplr, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t5wplr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t5wplr, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: failed to create HCP cluster for pull secret test
Unexpected error:
    <*fmt.wrapErrors | 0xc00138aab0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t5wplr, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t5wplr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t5wplr, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test
Unexpected error:
    <*fmt.wrapErrors | 0xc000cc48d0>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-jnctsc, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-jnctsc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-jnctsc, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test
Unexpected error:
    <*fmt.wrapErrors | 0xc000cc48d0>: 
    failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-jnctsc, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-jnctsc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-jnctsc, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-c9vx56 with version 4.20.24
Unexpected error:
    <*fmt.wrapErrors | 0xc000d724b0>: 
    failed to create HCP cluster np-version-upgrade-cluster-c9vx56, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-c9vx56 in resource group rg-np-version-upgrade-c9vx56-sj4pkd, error: failed waiting for cluster="np-version-upgrade-cluster-c9vx56" in resourcegroup="rg-np-version-upgrade-c9vx56-sj4pkd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-c9vx56 in resource group rg-np-version-upgrade-c9vx56-sj4pkd, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-c9vx56 with version 4.20.24
Unexpected error:
    <*fmt.wrapErrors | 0xc000d724b0>: 
    failed to create HCP cluster np-version-upgrade-cluster-c9vx56, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-c9vx56 in resource group rg-np-version-upgrade-c9vx56-sj4pkd, error: failed waiting for cluster="np-version-upgrade-cluster-c9vx56" in resourcegroup="rg-np-version-upgrade-c9vx56-sj4pkd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-c9vx56 in resource group rg-np-version-upgrade-c9vx56-sj4pkd, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-kb7j4g
Unexpected error:
    <*fmt.wrapErrors | 0xc0013acdb0>: 
    failed to create HCP cluster np-noedge-kb7j4g, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-kb7j4g in resource group rg-np-noedge-kb7j4g-dzbtrp, error: failed waiting for cluster="np-noedge-kb7j4g" in resourcegroup="rg-np-noedge-kb7j4g-dzbtrp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-kb7j4g in resource group rg-np-noedge-kb7j4g-dzbtrp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-kb7j4g
Unexpected error:
    <*fmt.wrapErrors | 0xc0013acdb0>: 
    failed to create HCP cluster np-noedge-kb7j4g, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-kb7j4g in resource group rg-np-noedge-kb7j4g-dzbtrp, error: failed waiting for cluster="np-noedge-kb7j4g" in resourcegroup="rg-np-noedge-kb7j4g-dzbtrp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-kb7j4g in resource group rg-np-noedge-kb7j4g-dzbtrp, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128"
Unexpected error:
    <*fmt.wrapErrors | 0xc001156570>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-2smgz4, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-2smgz4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-2smgz4, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128"
Unexpected error:
    <*fmt.wrapErrors | 0xc001156570>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-2smgz4, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-2smgz4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-2smgz4, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:596]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001502cc0>: 
    failed to create HCP cluster np-downgrade-vbs2v4, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-vbs2v4 in resource group rg-np-downgrade-vbs2v4-82t5zv, error: failed waiting for cluster="np-downgrade-vbs2v4" in resourcegroup="rg-np-downgrade-vbs2v4-82t5zv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-vbs2v4 in resource group rg-np-downgrade-vbs2v4-82t5zv, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:596]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001502cc0>: 
    failed to create HCP cluster np-downgrade-vbs2v4, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-vbs2v4 in resource group rg-np-downgrade-vbs2v4-82t5zv, error: failed waiting for cluster="np-downgrade-vbs2v4" in resourcegroup="rg-np-downgrade-vbs2v4-82t5zv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-vbs2v4 in resource group rg-np-downgrade-vbs2v4-82t5zv, error: context deadline exceeded
    ...
occurred
Interrupted by User
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:49]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:49]: Interrupted by User
Deserializaion Error: no output from command
10:57:20 UTC · failed at e2e · test MISE Routing routes to the correct frontend based on version header default route returns no version header · suite prod/parallel
Show raw failure
000aa5188, {0x914ca80, 0xc000125120}, 0xc001904a18?)
	/usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0019049e8 sp=0xc0019049b0 pc=0x319c0fe
crypto/tls.(*Conn).readRecordOrCCS(0xc000aa5188, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc001904c60 sp=0xc0019049e8 pc=0x319917b
crypto/tls.(*Conn).readRecord(...)
	/usr/lib/golang/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc000aa5188, {0xc0006af000, 0x1000, 0xc000308ba0?})
	/usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc001904cc8 sp=0xc001904c60 pc=0x319fa85
net/http.(*persistConn).Read(0xc000aff320, {0xc0006af000?, 0x3289b05?, 0x9145b00?})
	/usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc001904d28 sp=0xc001904cc8 pc=0x3291407
bufio.(*Reader).fill(0xc000f00480)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc001904d60 sp=0xc001904d28 pc=0x3031943
bufio.(*Reader).Peek(0xc000f00480, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc001904d80 sp=0xc001904d60 pc=0x3031ad3
net/http.(*persistConn).readLoop(0xc000aff320)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc001904fc8 sp=0xc001904d80 pc=0x3291f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc001904fe0 sp=0xc001904fc8 pc=0x32908a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc001904fe8 sp=0xc001904fe0 pc=0x2ed3cc1
created by net/http.(*Transport).dialConn in goroutine 129
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

goroutine 203 gp=0xc001600700 m=nil [sync.WaitGroup.Wait, 4 minutes]:
runtime.gopark(0xc0015fb5b0?, 0x2e62874?, 0x80?, 0x24?, 0x200c0013e0bd0?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0010f9550 sp=0xc0010f9530 pc=0x2ecb50e
runtime.goparkunlock(...)
	/usr/lib/golang/src/runtime/proc.go:466
runtime.semacquire1(0xc0013ea778, 0x0, 0x1, 0x0, 0x19)
	/usr/lib/golang/src/runtime/sema.go:192 +0x21d fp=0xc0010f95b8 sp=0xc0010f9550 pc=0x2ea759d
sync.runtime_SemacquireWaitGroup(0xc000519e20?, 0x0?)
	/usr/lib/golang/src/runtime/sema.go:114 +0x2e fp=0xc0010f95f0 sp=0xc0010f95b8 pc=0x2eccc2e
sync.(*WaitGroup).Wait(0xc0013ea770)
	/usr/lib/golang/src/sync/waitgroup.go:206 +0x85 fp=0xc0010f9618 sp=0xc0010f95f0 pc=0x2ef0405
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups(0xc000b99180, {0x7fa434753b08, 0xc00159b860}, {{0xc000ab4fb0, 0x1, 0x1}, 0x34630b8a000, {0x861de1c, 0x8}, {{0x0, ...}, ...}})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:371 +0x252 fp=0xc0010f9730 sp=0xc0010f9618 pc=0x6bae3d2
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).deleteCreatedResources(0xc000b99180, {0x7fa434753b08, 0xc00159b860})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:262 +0x250 fp=0xc0010f9888 sp=0xc0010f9730 pc=0x6badb30
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).deleteCreatedResources-fm({0x7fa434753b08?, 0xc00159b860?})
	<autogenerated>:1 +0x33 fp=0xc0010f98b0 sp=0xc0010f9888 pc=0x6bc9cd3
runtime.call16(0xc00177cc90, 0xc00069bf70, 0x0, 0x0, 0x0, 0x10, 0xc0010f9b08)
	/usr/lib/golang/src/runtime/asm_amd64.s:774 +0x43 fp=0xc0010f98d0 sp=0xc0010f98b0 pc=0x2ed2223
runtime.reflectcall(0x7ff4600?, 0xc00159b860?, 0x2?, 0x865590b?, 0x0?, 0x12?, 0x7bbaac0?)
	<autogenerated>:1 +0x36 fp=0xc0010f9910 sp=0xc0010f98d0 pc=0x2edaab6
reflect.Value.call({0x746fa60?, 0xc00069bf70?, 0xc000e8f3c8?}, {0x86117f8, 0x4}, {0xc00190ff60, 0x1, 0xc000d1ed70?})
	/usr/lib/golang/src/reflect/value.go:581 +0xcc6 fp=0xc0010f9e70 sp=0xc0010f9910 pc=0x2f0dc66
reflect.Value.Call({0x746fa60?, 0xc00069bf70?, 0x86102f5?}, {0xc00190ff60?, 0xc000e8f3c8?, 0x0?})
	/usr/lib/golang/src/reflect/value.go:365 +0xb9 fp=0xc0010f9ee8 sp=0xc0010f9e70 pc=0x2f0cd59
github.com/onsi/ginkgo/v2/internal.NewCleanupNode.func2({0x91fba30?, 0xc00159b860?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:589 +0x150 fp=0xc0010f9f88 sp=0xc0010f9ee8 pc=0x3331170
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc0010f9fe0 sp=0xc0010f9f88 pc=0x3343c3b
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0010f9fe8 sp=0xc0010f9fe0 pc=0x2ed3cc1
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 47
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50

rax    0xfffffffffffffffc
rbx    0x0
rcx    0x2ed5ae3
rdx    0x0
rdi    0xc7f2cb0
rsi    0x80
rbp    0x7fa43cb09cb8
rsp    0x7fa43cb09c70
r8     0x0
r9     0x0
r10    0x7fa43cb09ca8
r11    0x202
r12    0x7fa43cb09ca8
r13    0x1
r14    0xc000002c40
r15    0x0
rip    0x2ed5ae3
rflags 0x202
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserializaion Error: no output from command
000aa5188, {0x914ca80, 0xc000125120}, 0xc001904a18?)
	/usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0019049e8 sp=0xc0019049b0 pc=0x319c0fe
crypto/tls.(*Conn).readRecordOrCCS(0xc000aa5188, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc001904c60 sp=0xc0019049e8 pc=0x319917b
crypto/tls.(*Conn).readRecord(...)
	/usr/lib/golang/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc000aa5188, {0xc0006af000, 0x1000, 0xc000308ba0?})
	/usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc001904cc8 sp=0xc001904c60 pc=0x319fa85
net/http.(*persistConn).Read(0xc000aff320, {0xc0006af000?, 0x3289b05?, 0x9145b00?})
	/usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc001904d28 sp=0xc001904cc8 pc=0x3291407
bufio.(*Reader).fill(0xc000f00480)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc001904d60 sp=0xc001904d28 pc=0x3031943
bufio.(*Reader).Peek(0xc000f00480, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc001904d80 sp=0xc001904d60 pc=0x3031ad3
net/http.(*persistConn).readLoop(0xc000aff320)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc001904fc8 sp=0xc001904d80 pc=0x3291f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc001904fe0 sp=0xc001904fc8 pc=0x32908a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc001904fe8 sp=0xc001904fe0 pc=0x2ed3cc1
created by net/http.(*Transport).dialConn in goroutine 129
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

goroutine 203 gp=0xc001600700 m=nil [sync.WaitGroup.Wait, 4 minutes]:
runtime.gopark(0xc0015fb5b0?, 0x2e62874?, 0x80?, 0x24?, 0x200c0013e0bd0?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0010f9550 sp=0xc0010f9530 pc=0x2ecb50e
runtime.goparkunlock(...)
	/usr/lib/golang/src/runtime/proc.go:466
runtime.semacquire1(0xc0013ea778, 0x0, 0x1, 0x0, 0x19)
	/usr/lib/golang/src/runtime/sema.go:192 +0x21d fp=0xc0010f95b8 sp=0xc0010f9550 pc=0x2ea759d
sync.runtime_SemacquireWaitGroup(0xc000519e20?, 0x0?)
	/usr/lib/golang/src/runtime/sema.go:114 +0x2e fp=0xc0010f95f0 sp=0xc0010f95b8 pc=0x2eccc2e
sync.(*WaitGroup).Wait(0xc0013ea770)
	/usr/lib/golang/src/sync/waitgroup.go:206 +0x85 fp=0xc0010f9618 sp=0xc0010f95f0 pc=0x2ef0405
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups(0xc000b99180, {0x7fa434753b08, 0xc00159b860}, {{0xc000ab4fb0, 0x1, 0x1}, 0x34630b8a000, {0x861de1c, 0x8}, {{0x0, ...}, ...}})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:371 +0x252 fp=0xc0010f9730 sp=0xc0010f9618 pc=0x6bae3d2
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).deleteCreatedResources(0xc000b99180, {0x7fa434753b08, 0xc00159b860})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:262 +0x250 fp=0xc0010f9888 sp=0xc0010f9730 pc=0x6badb30
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).deleteCreatedResources-fm({0x7fa434753b08?, 0xc00159b860?})
	<autogenerated>:1 +0x33 fp=0xc0010f98b0 sp=0xc0010f9888 pc=0x6bc9cd3
runtime.call16(0xc00177cc90, 0xc00069bf70, 0x0, 0x0, 0x0, 0x10, 0xc0010f9b08)
	/usr/lib/golang/src/runtime/asm_amd64.s:774 +0x43 fp=0xc0010f98d0 sp=0xc0010f98b0 pc=0x2ed2223
runtime.reflectcall(0x7ff4600?, 0xc00159b860?, 0x2?, 0x865590b?, 0x0?, 0x12?, 0x7bbaac0?)
	<autogenerated>:1 +0x36 fp=0xc0010f9910 sp=0xc0010f98d0 pc=0x2edaab6
reflect.Value.call({0x746fa60?, 0xc00069bf70?, 0xc000e8f3c8?}, {0x86117f8, 0x4}, {0xc00190ff60, 0x1, 0xc000d1ed70?})
	/usr/lib/golang/src/reflect/value.go:581 +0xcc6 fp=0xc0010f9e70 sp=0xc0010f9910 pc=0x2f0dc66
reflect.Value.Call({0x746fa60?, 0xc00069bf70?, 0x86102f5?}, {0xc00190ff60?, 0xc000e8f3c8?, 0x0?})
	/usr/lib/golang/src/reflect/value.go:365 +0xb9 fp=0xc0010f9ee8 sp=0xc0010f9e70 pc=0x2f0cd59
github.com/onsi/ginkgo/v2/internal.NewCleanupNode.func2({0x91fba30?, 0xc00159b860?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:589 +0x150 fp=0xc0010f9f88 sp=0xc0010f9ee8 pc=0x3331170
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc0010f9fe0 sp=0xc0010f9f88 pc=0x3343c3b
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0010f9fe8 sp=0xc0010f9fe0 pc=0x2ed3cc1
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 47
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50

rax    0xfffffffffffffffc
rbx    0x0
rcx    0x2ed5ae3
rdx    0x0
rdi    0xc7f2cb0
rsi    0x80
rbp    0x7fa43cb09cb8
rsp    0x7fa43cb09c70
r8     0x0
r9     0x0
r10    0x7fa43cb09ca8
r11    0x202
r12    0x7fa43cb09ca8
r13    0x1
r14    0xc000002c40
r15    0x0
rip    0x2ed5ae3
rflags 0x202
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-sxwhcd/cluster-nightly-4-23-dcgnth should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0014c0960>: 
    failed waiting for cluster="cluster-nightly-4-23-dcgnth" in resourcegroup="rg-nightly-4-23-sxwhcd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-dcgnth in resource group rg-nightly-4-23-sxwhcd, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-sxwhcd/cluster-nightly-4-23-dcgnth should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0014c0960>: 
    failed waiting for cluster="cluster-nightly-4-23-dcgnth" in resourcegroup="rg-nightly-4-23-sxwhcd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-dcgnth in resource group rg-nightly-4-23-sxwhcd, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc001131680>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-tc8wx2, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-tc8wx2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-tc8wx2, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc001131680>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-tc8wx2, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-tc8wx2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-tc8wx2, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:466]: failed to create HCP cluster np-skip-minor-hgvtjq at version 4.22.0
Unexpected error:
    <*fmt.wrapErrors | 0xc0006c6960>: 
    failed to create HCP cluster np-skip-minor-hgvtjq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-hgvtjq in resource group rg-np-skip-minor-hgvtjq-79zn8d, error: failed waiting for cluster="np-skip-minor-hgvtjq" in resourcegroup="rg-np-skip-minor-hgvtjq-79zn8d" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-hgvtjq in resource group rg-np-skip-minor-hgvtjq-79zn8d, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:466]: failed to create HCP cluster np-skip-minor-hgvtjq at version 4.22.0
Unexpected error:
    <*fmt.wrapErrors | 0xc0006c6960>: 
    failed to create HCP cluster np-skip-minor-hgvtjq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-hgvtjq in resource group rg-np-skip-minor-hgvtjq-79zn8d, error: failed waiting for cluster="np-skip-minor-hgvtjq" in resourcegroup="rg-np-skip-minor-hgvtjq-79zn8d" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-hgvtjq in resource group rg-np-skip-minor-hgvtjq-79zn8d, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-p9c85q with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc0011cc8a0>: 
    failed to create HCP cluster np-version-upgrade-cluster-p9c85q, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-p9c85q in resource group rg-np-version-upgrade-p9c85q-d4lnrh, error: failed waiting for cluster="np-version-upgrade-cluster-p9c85q" in resourcegroup="rg-np-version-upgrade-p9c85q-d4lnrh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-p9c85q in resource group rg-np-version-upgrade-p9c85q-d4lnrh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-p9c85q with version 4.21.19
Unexpected error:
    <*fmt.wrapErrors | 0xc0011cc8a0>: 
    failed to create HCP cluster np-version-upgrade-cluster-p9c85q, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-p9c85q in resource group rg-np-version-upgrade-p9c85q-d4lnrh, error: failed waiting for cluster="np-version-upgrade-cluster-p9c85q" in resourcegroup="rg-np-version-upgrade-p9c85q-d4lnrh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-p9c85q in resource group rg-np-version-upgrade-p9c85q-d4lnrh, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-21-kzhdgd/cluster-candidate-4-21-pvzm27 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000924630>: 
    failed to create HCP cluster cluster-candidate-4-21-pvzm27, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-pvzm27 in resource group rg-candidate-4-21-kzhdgd, error: failed waiting for cluster="cluster-candidate-4-21-pvzm27" in resourcegroup="rg-candidate-4-21-kzhdgd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-pvzm27 in resource group rg-candidate-4-21-kzhdgd, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-21-kzhdgd/cluster-candidate-4-21-pvzm27 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000924630>: 
    failed to create HCP cluster cluster-candidate-4-21-pvzm27, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-pvzm27 in resource group rg-candidate-4-21-kzhdgd, error: failed waiting for cluster="cluster-candidate-4-21-pvzm27" in resourcegroup="rg-candidate-4-21-kzhdgd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-pvzm27 in resource group rg-candidate-4-21-kzhdgd, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test
Unexpected error:
    <*fmt.wrapErrors | 0xc00091c750>: 
    failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-p6mnm2, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-p6mnm2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-p6mnm2, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test
Unexpected error:
    <*fmt.wrapErrors | 0xc00091c750>: 
    failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-p6mnm2, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-p6mnm2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-p6mnm2, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-19-s8kqtd" with version 4.19.31 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00121c6f0>: 
    failed to create HCP cluster cluster-zstream-4-19-s8kqtd, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-s8kqtd in resource group rg-zstream-upgrade-4-19-k4qclk, error: failed waiting for cluster="cluster-zstream-4-19-s8kqtd" in resourcegroup="rg-zstream-upgrade-4-19-k4qclk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-s8kqtd in resource group rg-zstream-upgrade-4-19-k4qclk, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-19-s8kqtd" with version 4.19.31 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00121c6f0>: 
    failed to create HCP cluster cluster-zstream-4-19-s8kqtd, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-s8kqtd in resource group rg-zstream-upgrade-4-19-k4qclk, error: failed waiting for cluster="cluster-zstream-4-19-s8kqtd" in resourcegroup="rg-zstream-upgrade-4-19-k4qclk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-s8kqtd in resource group rg-zstream-upgrade-4-19-k4qclk, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:89]: failed to create HCP cluster "arm64-vm-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00152a8d0>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-84dtr7, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-84dtr7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-84dtr7, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:89]: failed to create HCP cluster "arm64-vm-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc00152a8d0>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-84dtr7, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-84dtr7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-84dtr7, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0011368d0>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-j2ff9b, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-j2ff9b" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-j2ff9b, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc0011368d0>: 
    failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-j2ff9b, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-j2ff9b" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-j2ff9b, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-22-7vwkd6" with version 4.22.0-rc.4 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00104c450>: 
    failed to create HCP cluster cluster-zstream-4-22-7vwkd6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-7vwkd6 in resource group rg-zstream-upgrade-4-22-std5tp, error: failed waiting for cluster="cluster-zstream-4-22-7vwkd6" in resourcegroup="rg-zstream-upgrade-4-22-std5tp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-7vwkd6 in resource group rg-zstream-upgrade-4-22-std5tp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-22-7vwkd6" with version 4.22.0-rc.4 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00104c450>: 
    failed to create HCP cluster cluster-zstream-4-22-7vwkd6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-7vwkd6 in resource group rg-zstream-upgrade-4-22-std5tp, error: failed waiting for cluster="cluster-zstream-4-22-7vwkd6" in resourcegroup="rg-zstream-upgrade-4-22-std5tp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-7vwkd6 in resource group rg-zstream-upgrade-4-22-std5tp, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc001714960>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-m4bm2h, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-m4bm2h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-m4bm2h, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc001714960>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-m4bm2h, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-m4bm2h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-m4bm2h, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-20-jxw4bq" with version 4.20.23 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000a7eea0>: 
    failed to create HCP cluster cluster-zstream-4-20-jxw4bq, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-jxw4bq in resource group rg-zstream-upgrade-4-20-9gb8tt, error: failed waiting for cluster="cluster-zstream-4-20-jxw4bq" in resourcegroup="rg-zstream-upgrade-4-20-9gb8tt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-jxw4bq in resource group rg-zstream-upgrade-4-20-9gb8tt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-20-jxw4bq" with version 4.20.23 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000a7eea0>: 
    failed to create HCP cluster cluster-zstream-4-20-jxw4bq, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-jxw4bq in resource group rg-zstream-upgrade-4-20-9gb8tt, error: failed waiting for cluster="cluster-zstream-4-20-jxw4bq" in resourcegroup="rg-zstream-upgrade-4-20-9gb8tt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-jxw4bq in resource group rg-zstream-upgrade-4-20-9gb8tt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints
Unexpected error:
    <*fmt.wrapErrors | 0xc001458ab0>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-c2s2ht, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-c2s2ht" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-c2s2ht, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints
Unexpected error:
    <*fmt.wrapErrors | 0xc001458ab0>: 
    failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-c2s2ht, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-c2s2ht" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-c2s2ht, error: context deadline exceeded
    ...
occurred
Deserializaion Error: no output from command
10:57:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel
Show raw failure
{0xc00007a094, 0x2a}, 0x0, {0xc0007868e0, ...})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496
          > github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a094, 0x2a}, ...)
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68
            github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2e5aa85?, 0xc000ab0d80?})
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/ginkgo/util.go:84
            github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x91e1708, 0xc000e157c0}, 0xc000a57380, 0x1)
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:596
            github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:237
            github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:230

          goroutine 88 [select]
          > github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts.func2(0xc000a57380?)
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:131
          > github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts in goroutine 87
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:128
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137 @ 06/12/26 13:49:03.006
  "ts"="2026-06-12 13:49:03.007583" "level"=0 "msg"="===== TEST CASE ENDED: FAILURE ====="
  "ts"="2026-06-12 13:49:03.007634" "level"=0 "msg"="===== CLEANUP BEGAN ====="
  "ts"="2026-06-12 13:49:03.007761" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-06-12 13:49:03.007887" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-cluster-candidate-4-20-5pvqrv-67ffr4" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 13:49:03.075105" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-cluster-candidate-4-20-5pvqrv-67ffr4" "resourceGroup"=""
  "ts"="2026-06-12 13:49:03.778877" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-d4ee2620a775558818d65bdad60edec7ff8775b05730402bc0de88c0d1c3d86f.yaml.gz"
  "ts"="2026-06-12 13:49:03.779022" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-d4ee2620a775558818d65bdad60edec7ff8775b05730402bc0de88c0d1c3d86f.yaml.gz"
  "ts"="2026-06-12 13:49:03.779140" "level"=0 "msg"="collecting debug info"
  "ts"="2026-06-12 13:49:03.781368" "level"=0 "msg"="collecting deployments" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 13:49:03.781396" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-148"
  "ts"="2026-06-12 13:49:04.152510" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-candidate-4-20-vpbqs7" "deployment"="pooledNonMsiScopedAssignments-34bborbknryhu"
  "ts"="2026-06-12 13:49:04.166599" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-148" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-06-12 13:49:04.243967" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-candidate-4-20-vpbqs7" "deployment"="customer-infra-cluster-candidate-4-20-5pvqrv-67ffr4"
  "ts"="2026-06-12 13:49:04.475079" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-148" "deployment"="msi-deployment-148"
  "ts"="2026-06-12 13:49:04.599107" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-06-12 13:49:05.015191" "level"=0 "msg"="deleting created resources"
  "ts"="2026-06-12 13:49:05.015430" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 14:02:43.842163" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 14:02:43.842189" "level"=0 "msg"="deleting resource group" "resourceGroup"="rg-candidate-4-20-vpbqs7"
Command Error: signal: killed
Deserializaion Error: no output from command
{0xc00007a094, 0x2a}, 0x0, {0xc0007868e0, ...})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496
          > github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a094, 0x2a}, ...)
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68
            github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2e5aa85?, 0xc000ab0d80?})
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/ginkgo/util.go:84
            github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x91e1708, 0xc000e157c0}, 0xc000a57380, 0x1)
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:596
            github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:237
            github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
              /go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260422120742-50dec0b5ecf3/pkg/extension/extensiontests/spec.go:230

          goroutine 88 [select]
          > github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts.func2(0xc000a57380?)
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:131
          > github.com/onsi/ginkgo/v2/internal/interrupt_handler.(*InterruptHandler).registerForInterrupts in goroutine 87
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/interrupt_handler/interrupt_handler.go:128
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137 @ 06/12/26 13:49:03.006
  "ts"="2026-06-12 13:49:03.007583" "level"=0 "msg"="===== TEST CASE ENDED: FAILURE ====="
  "ts"="2026-06-12 13:49:03.007634" "level"=0 "msg"="===== CLEANUP BEGAN ====="
  "ts"="2026-06-12 13:49:03.007761" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-06-12 13:49:03.007887" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-cluster-candidate-4-20-5pvqrv-67ffr4" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 13:49:03.075105" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-cluster-candidate-4-20-5pvqrv-67ffr4" "resourceGroup"=""
  "ts"="2026-06-12 13:49:03.778877" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-d4ee2620a775558818d65bdad60edec7ff8775b05730402bc0de88c0d1c3d86f.yaml.gz"
  "ts"="2026-06-12 13:49:03.779022" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-d4ee2620a775558818d65bdad60edec7ff8775b05730402bc0de88c0d1c3d86f.yaml.gz"
  "ts"="2026-06-12 13:49:03.779140" "level"=0 "msg"="collecting debug info"
  "ts"="2026-06-12 13:49:03.781368" "level"=0 "msg"="collecting deployments" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 13:49:03.781396" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-148"
  "ts"="2026-06-12 13:49:04.152510" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-candidate-4-20-vpbqs7" "deployment"="pooledNonMsiScopedAssignments-34bborbknryhu"
  "ts"="2026-06-12 13:49:04.166599" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-148" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-06-12 13:49:04.243967" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-candidate-4-20-vpbqs7" "deployment"="customer-infra-cluster-candidate-4-20-5pvqrv-67ffr4"
  "ts"="2026-06-12 13:49:04.475079" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-148" "deployment"="msi-deployment-148"
  "ts"="2026-06-12 13:49:04.599107" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-06-12 13:49:05.015191" "level"=0 "msg"="deleting created resources"
  "ts"="2026-06-12 13:49:05.015430" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 14:02:43.842163" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="rg-candidate-4-20-vpbqs7"
  "ts"="2026-06-12 14:02:43.842189" "level"=0 "msg"="deleting resource group" "resourceGroup"="rg-candidate-4-20-vpbqs7"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159]: failed to create HCP cluster for patch-tags test
Unexpected error:
    <*fmt.wrapErrors | 0xc00140a510>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-xt5mwq, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-xt5mwq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-xt5mwq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159]: failed to create HCP cluster for patch-tags test
Unexpected error:
    <*fmt.wrapErrors | 0xc00140a510>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-xt5mwq, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-xt5mwq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-xt5mwq, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:134]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs
Unexpected error:
    <*fmt.wrapErrors | 0xc000b0cde0>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-k864vq, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-k864vq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-k864vq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:134]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs
Unexpected error:
    <*fmt.wrapErrors | 0xc000b0cde0>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-k864vq, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-k864vq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-k864vq, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc000f682a0>: 
    failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-snfshf, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-snfshf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-snfshf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc000f682a0>: 
    failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-snfshf, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-snfshf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-snfshf, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:282]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit
Unexpected error:
    <*fmt.wrapErrors | 0xc0016824e0>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-d7qmw7, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-d7qmw7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-d7qmw7, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:282]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit
Unexpected error:
    <*fmt.wrapErrors | 0xc0016824e0>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-d7qmw7, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-d7qmw7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-d7qmw7, error: context deadline exceeded
    ...
occurred
cluster has not yet reached Succeeded state
10:57:20 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.007s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.007s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc0011e22a0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-nf5q4s" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-nf5q4s, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc0011e22a0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-nf5q4s" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-nf5q4s, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-21-q5c6ls" with version 4.21.0-rc.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00140aa20>: 
    failed to create HCP cluster cluster-zstream-4-21-q5c6ls, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-q5c6ls in resource group rg-zstream-upgrade-4-21-p9576j, error: failed waiting for cluster="cluster-zstream-4-21-q5c6ls" in resourcegroup="rg-zstream-upgrade-4-21-p9576j" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-q5c6ls in resource group rg-zstream-upgrade-4-21-p9576j, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-21-q5c6ls" with version 4.21.0-rc.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00140aa20>: 
    failed to create HCP cluster cluster-zstream-4-21-q5c6ls, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-q5c6ls in resource group rg-zstream-upgrade-4-21-p9576j, error: failed waiting for cluster="cluster-zstream-4-21-q5c6ls" in resourcegroup="rg-zstream-upgrade-4-21-p9576j" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-q5c6ls in resource group rg-zstream-upgrade-4-21-p9576j, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk
Unexpected error:
    <*fmt.wrapErrors | 0xc0010212f0>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-9pfz8v, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-9pfz8v" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-9pfz8v, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk
Unexpected error:
    <*fmt.wrapErrors | 0xc0010212f0>: 
    failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-9pfz8v, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-9pfz8v" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-9pfz8v, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI
Unexpected error:
    <*fmt.wrapErrors | 0xc00160ced0>: 
    failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-8z699g, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-8z699g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-8z699g, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI
Unexpected error:
    <*fmt.wrapErrors | 0xc00160ced0>: 
    failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-8z699g, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-8z699g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-8z699g, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000cfebd0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-6rmdxd, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-6rmdxd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-6rmdxd, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000cfebd0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-6rmdxd, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-6rmdxd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-6rmdxd, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled
Unexpected error:
    <*fmt.wrapErrors | 0xc000cb0ff0>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-8gn4wh, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-8gn4wh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-8gn4wh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled
Unexpected error:
    <*fmt.wrapErrors | 0xc000cb0ff0>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-8gn4wh, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-8gn4wh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-8gn4wh, error: context deadline exceeded
    ...
occurred
failed to wait for first cluster "<cluster>" to complete creation
10:57:20 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation
Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation
Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
Cluster should become ready within '20.000000' minutes
10:57:20 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:57:20 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test
Unexpected error:
    <*fmt.wrapErrors | 0xc0005406f0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gqg7ws, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-gqg7ws" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gqg7ws, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test
Unexpected error:
    <*fmt.wrapErrors | 0xc0005406f0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gqg7ws, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-gqg7ws" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gqg7ws, error: context deadline exceeded
    ...
occurred
branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 7
e2e (7)
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
05:22:54 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001285cb0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-qtjzpx, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-qtjzpx" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001285cb0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-qtjzpx, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-qtjzpx" to finish creating: context deadline exceeded
    ...
occurred
</html>
05:22:54 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:75]: failed to get latest install version for nightly channel: after 4 attempts: query nightly tags for 4.23.0-0.nightly-multi returned 503 Service Unavailable: <html>
  <head>
    <meta name="viewport" content="width=device-width, initial-scale=1">

    <style type="text/css">
      body {
        font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
        line-height: 1.66666667;
        font-size: 16px;
        color: #333;
        background-color: #fff;
        margin: 2em 1em;
      }
      h1 {
        font-size: 28px;
        font-weight: 400;
      }
      p {
        margin: 0 0 10px;
      }
      .alert.alert-info {
        background-color: #F0F0F0;
        margin-top: 30px;
        padding: 30px;
      }
      .alert p {
        padding-left: 35px;
      }
      ul {
        padding-left: 51px;
        position: relative;
      }
      li {
        font-size: 14px;
        margin-bottom: 1em;
      }
      p.info {
        position: relative;
        font-size: 20px;
      }
      p.info:before, p.info:after {
        content: "";
        left: 0;
        position: absolute;
        top: 0;
      }
      p.info:before {
        background: #0066CC;
        border-radius: 16px;
        color: #fff;
        content: "i";
        font: bold 16px/24px serif;
        height: 24px;
        left: 0px;
        text-align: center;
        top: 4px;
        width: 24px;
      }

      @media (min-width: 768px) {
        body {
          margin: 6em;
        }
      }
    </style>
  </head>
  <body>
    <div>
      <h1>Application is not available</h1>
      <p>The application is currently not serving requests at this endpoint. It may not have been started or is still starting.</p>

      <div class="alert alert-info">
        <p class="info">
          Possible reasons you are seeing this page:
        </p>
        <ul>
          <li>
            <strong>The host doesn't exist.</strong>
            Make sure the hostname was typed correctly and that a route matching this hostname exists.
          </li>
          <li>
            <strong>The host exists, but doesn't have a matching path.</strong>
            Check if the URL path was typed correctly and that the route was created using the desired path.
          </li>
          <li>
            <strong>Route and path matches, but all pods are down.</strong>
            Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
          </li>
        </ul>
      </div>
    </div>
  </body>
</html>
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:75]: failed to get latest install version for nightly channel: after 4 attempts: query nightly tags for 4.23.0-0.nightly-multi returned 503 Service Unavailable: <html>
  <head>
    <meta name="viewport" content="width=device-width, initial-scale=1">

    <style type="text/css">
      body {
        font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
        line-height: 1.66666667;
        font-size: 16px;
        color: #333;
        background-color: #fff;
        margin: 2em 1em;
      }
      h1 {
        font-size: 28px;
        font-weight: 400;
      }
      p {
        margin: 0 0 10px;
      }
      .alert.alert-info {
        background-color: #F0F0F0;
        margin-top: 30px;
        padding: 30px;
      }
      .alert p {
        padding-left: 35px;
      }
      ul {
        padding-left: 51px;
        position: relative;
      }
      li {
        font-size: 14px;
        margin-bottom: 1em;
      }
      p.info {
        position: relative;
        font-size: 20px;
      }
      p.info:before, p.info:after {
        content: "";
        left: 0;
        position: absolute;
        top: 0;
      }
      p.info:before {
        background: #0066CC;
        border-radius: 16px;
        color: #fff;
        content: "i";
        font: bold 16px/24px serif;
        height: 24px;
        left: 0px;
        text-align: center;
        top: 4px;
        width: 24px;
      }

      @media (min-width: 768px) {
        body {
          margin: 6em;
        }
      }
    </style>
  </head>
  <body>
    <div>
      <h1>Application is not available</h1>
      <p>The application is currently not serving requests at this endpoint. It may not have been started or is still starting.</p>

      <div class="alert alert-info">
        <p class="info">
          Possible reasons you are seeing this page:
        </p>
        <ul>
          <li>
            <strong>The host doesn't exist.</strong>
            Make sure the hostname was typed correctly and that a route matching this hostname exists.
          </li>
          <li>
            <strong>The host exists, but doesn't have a matching path.</strong>
            Check if the URL path was typed correctly and that the route was created using the desired path.
          </li>
          <li>
            <strong>Route and path matches, but all pods are down.</strong>
            Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
          </li>
        </ul>
      </div>
    </div>
  </body>
</html>
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
05:22:54 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-58vbqc" for cluster "cluster-candidate-4-22-58vbqc"
Unexpected error:
    <*fmt.wrapErrors | 0xc000ad64e0>: 
    failed to create NodePool np-58vbqc, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-58vbqc in resource group rg-candidate-4-22-mhlbbg, error: failed waiting for nodepool="np-58vbqc" for cluster "cluster-candidate-4-22-58vbqc" in resourcegroup="rg-candidate-4-22-mhlbbg" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-58vbqc" for cluster "cluster-candidate-4-22-58vbqc"
Unexpected error:
    <*fmt.wrapErrors | 0xc000ad64e0>: 
    failed to create NodePool np-58vbqc, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-58vbqc in resource group rg-candidate-4-22-mhlbbg, error: failed waiting for nodepool="np-58vbqc" for cluster "cluster-candidate-4-22-58vbqc" in resourcegroup="rg-candidate-4-22-mhlbbg" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
05:22:54 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc000f7e7e0>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-tfrswl, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-tfrswl" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc000f7e7e0>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-tfrswl, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-tfrswl" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
05:22:54 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-c28plp" for cluster "cluster-candidate-4-20-c28plp"
Unexpected error:
    <*fmt.wrapErrors | 0xc000e6b410>: 
    failed to create NodePool np-c28plp, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-c28plp in resource group rg-candidate-4-20-pw9gpf, error: failed waiting for nodepool="np-c28plp" for cluster "cluster-candidate-4-20-c28plp" in resourcegroup="rg-candidate-4-20-pw9gpf" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-c28plp" for cluster "cluster-candidate-4-20-c28plp"
Unexpected error:
    <*fmt.wrapErrors | 0xc000e6b410>: 
    failed to create NodePool np-c28plp, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-c28plp in resource group rg-candidate-4-20-pw9gpf, error: failed waiting for nodepool="np-c28plp" for cluster "cluster-candidate-4-20-c28plp" in resourcegroup="rg-candidate-4-20-pw9gpf" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
05:22:54 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-7th746" for cluster "cluster-candidate-4-21-7th746"
Unexpected error:
    <*fmt.wrapErrors | 0xc00102a390>: 
    failed to create NodePool np-7th746, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-7th746 in resource group rg-candidate-4-21-42wwph, error: failed waiting for nodepool="np-7th746" for cluster "cluster-candidate-4-21-7th746" in resourcegroup="rg-candidate-4-21-42wwph" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-7th746" for cluster "cluster-candidate-4-21-7th746"
Unexpected error:
    <*fmt.wrapErrors | 0xc00102a390>: 
    failed to create NodePool np-7th746, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-7th746 in resource group rg-candidate-4-21-42wwph, error: failed waiting for nodepool="np-7th746" for cluster "cluster-candidate-4-21-7th746" in resourcegroup="rg-candidate-4-21-42wwph" to finish creating: context deadline exceeded
    ...
occurred
</html>
05:22:54 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:75]: failed to get latest install version for nightly channel: after 4 attempts: query nightly tags for 5.0.0-0.nightly-multi returned 503 Service Unavailable: <html>
  <head>
    <meta name="viewport" content="width=device-width, initial-scale=1">

    <style type="text/css">
      body {
        font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
        line-height: 1.66666667;
        font-size: 16px;
        color: #333;
        background-color: #fff;
        margin: 2em 1em;
      }
      h1 {
        font-size: 28px;
        font-weight: 400;
      }
      p {
        margin: 0 0 10px;
      }
      .alert.alert-info {
        background-color: #F0F0F0;
        margin-top: 30px;
        padding: 30px;
      }
      .alert p {
        padding-left: 35px;
      }
      ul {
        padding-left: 51px;
        position: relative;
      }
      li {
        font-size: 14px;
        margin-bottom: 1em;
      }
      p.info {
        position: relative;
        font-size: 20px;
      }
      p.info:before, p.info:after {
        content: "";
        left: 0;
        position: absolute;
        top: 0;
      }
      p.info:before {
        background: #0066CC;
        border-radius: 16px;
        color: #fff;
        content: "i";
        font: bold 16px/24px serif;
        height: 24px;
        left: 0px;
        text-align: center;
        top: 4px;
        width: 24px;
      }

      @media (min-width: 768px) {
        body {
          margin: 6em;
        }
      }
    </style>
  </head>
  <body>
    <div>
      <h1>Application is not available</h1>
      <p>The application is currently not serving requests at this endpoint. It may not have been started or is still starting.</p>

      <div class="alert alert-info">
        <p class="info">
          Possible reasons you are seeing this page:
        </p>
        <ul>
          <li>
            <strong>The host doesn't exist.</strong>
            Make sure the hostname was typed correctly and that a route matching this hostname exists.
          </li>
          <li>
            <strong>The host exists, but doesn't have a matching path.</strong>
            Check if the URL path was typed correctly and that the route was created using the desired path.
          </li>
          <li>
            <strong>Route and path matches, but all pods are down.</strong>
            Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
          </li>
        </ul>
      </div>
    </div>
  </body>
</html>
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:75]: failed to get latest install version for nightly channel: after 4 attempts: query nightly tags for 5.0.0-0.nightly-multi returned 503 Service Unavailable: <html>
  <head>
    <meta name="viewport" content="width=device-width, initial-scale=1">

    <style type="text/css">
      body {
        font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
        line-height: 1.66666667;
        font-size: 16px;
        color: #333;
        background-color: #fff;
        margin: 2em 1em;
      }
      h1 {
        font-size: 28px;
        font-weight: 400;
      }
      p {
        margin: 0 0 10px;
      }
      .alert.alert-info {
        background-color: #F0F0F0;
        margin-top: 30px;
        padding: 30px;
      }
      .alert p {
        padding-left: 35px;
      }
      ul {
        padding-left: 51px;
        position: relative;
      }
      li {
        font-size: 14px;
        margin-bottom: 1em;
      }
      p.info {
        position: relative;
        font-size: 20px;
      }
      p.info:before, p.info:after {
        content: "";
        left: 0;
        position: absolute;
        top: 0;
      }
      p.info:before {
        background: #0066CC;
        border-radius: 16px;
        color: #fff;
        content: "i";
        font: bold 16px/24px serif;
        height: 24px;
        left: 0px;
        text-align: center;
        top: 4px;
        width: 24px;
      }

      @media (min-width: 768px) {
        body {
          margin: 6em;
        }
      }
    </style>
  </head>
  <body>
    <div>
      <h1>Application is not available</h1>
      <p>The application is currently not serving requests at this endpoint. It may not have been started or is still starting.</p>

      <div class="alert alert-info">
        <p class="info">
          Possible reasons you are seeing this page:
        </p>
        <ul>
          <li>
            <strong>The host doesn't exist.</strong>
            Make sure the hostname was typed correctly and that a route matching this hostname exists.
          </li>
          <li>
            <strong>The host exists, but doesn't have a matching path.</strong>
            Check if the URL path was typed correctly and that the route was created using the desired path.
          </li>
          <li>
            <strong>Route and path matches, but all pods are down.</strong>
            Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
          </li>
        </ul>
      </div>
    </div>
  </body>
</html>
branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
unknown failed n/a 1 non-artifact-backed failure (no junit artifacts)
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 2
e2e (2)
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:02 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-lvbhzt/cluster-nightly-5-0-7knptb should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000b134a0>: 
    failed waiting for cluster="cluster-nightly-5-0-7knptb" in resourcegroup="rg-nightly-5-0-lvbhzt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-7knptb in resource group rg-nightly-5-0-lvbhzt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-lvbhzt/cluster-nightly-5-0-7knptb should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000b134a0>: 
    failed waiting for cluster="cluster-nightly-5-0-7knptb" in resourcegroup="rg-nightly-5-0-lvbhzt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-7knptb in resource group rg-nightly-5-0-lvbhzt, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:02 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-h4gwgz/cluster-nightly-4-23-qrhj84 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000720090>: 
    failed waiting for cluster="cluster-nightly-4-23-qrhj84" in resourcegroup="rg-nightly-4-23-h4gwgz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-qrhj84 in resource group rg-nightly-4-23-h4gwgz, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-h4gwgz/cluster-nightly-4-23-qrhj84 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000720090>: 
    failed waiting for cluster="cluster-nightly-4-23-qrhj84" in resourcegroup="rg-nightly-4-23-h4gwgz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-qrhj84 in resource group rg-nightly-4-23-h4gwgz, error: context deadline exceeded
    ...
occurred