<
Single Day: Jun 14
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 9
e2e (9)
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:10 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc001512570>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-tn428m, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-tn428m" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-tn428m, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapErrors | 0xc001512570>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-tn428m, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-tn428m" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-tn428m, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:10 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-jwb2cx/cluster-nightly-5-0-2wnwdn should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0010cc660>: 
    failed waiting for cluster="cluster-nightly-5-0-2wnwdn" in resourcegroup="rg-nightly-5-0-jwb2cx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-2wnwdn in resource group rg-nightly-5-0-jwb2cx, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-jwb2cx/cluster-nightly-5-0-2wnwdn should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0010cc660>: 
    failed waiting for cluster="cluster-nightly-5-0-2wnwdn" in resourcegroup="rg-nightly-5-0-jwb2cx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-2wnwdn in resource group rg-nightly-5-0-jwb2cx, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:10 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-nightly-4-20-tvmzpn/cluster-nightly-4-20-rp6bj2 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000eb12c0>: 
    failed to create HCP cluster cluster-nightly-4-20-rp6bj2, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-rp6bj2 in resource group rg-nightly-4-20-tvmzpn, error: failed waiting for cluster="cluster-nightly-4-20-rp6bj2" in resourcegroup="rg-nightly-4-20-tvmzpn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-rp6bj2 in resource group rg-nightly-4-20-tvmzpn, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-nightly-4-20-tvmzpn/cluster-nightly-4-20-rp6bj2 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000eb12c0>: 
    failed to create HCP cluster cluster-nightly-4-20-rp6bj2, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-rp6bj2 in resource group rg-nightly-4-20-tvmzpn, error: failed waiting for cluster="cluster-nightly-4-20-rp6bj2" in resourcegroup="rg-nightly-4-20-tvmzpn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-rp6bj2 in resource group rg-nightly-4-20-tvmzpn, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:10 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0013d4438>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-5nhhnb, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-5nhhnb" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0013d4438>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-5nhhnb, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-5nhhnb" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:10 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-t2zvsb" for cluster "cluster-nightly-4-22-t2zvsb"
Unexpected error:
    <*fmt.wrapErrors | 0xc000c15050>: 
    failed to create NodePool np-t2zvsb, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-t2zvsb in resource group rg-nightly-4-22-fsszt4, error: failed waiting for nodepool="np-t2zvsb" for cluster "cluster-nightly-4-22-t2zvsb" in resourcegroup="rg-nightly-4-22-fsszt4" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-t2zvsb" for cluster "cluster-nightly-4-22-t2zvsb"
Unexpected error:
    <*fmt.wrapErrors | 0xc000c15050>: 
    failed to create NodePool np-t2zvsb, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-t2zvsb in resource group rg-nightly-4-22-fsszt4, error: failed waiting for nodepool="np-t2zvsb" for cluster "cluster-nightly-4-22-t2zvsb" in resourcegroup="rg-nightly-4-22-fsszt4" to finish creating: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:10 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-w5pt4m" for cluster "cluster-nightly-4-21-w5pt4m"
Unexpected error:
    <*fmt.wrapErrors | 0xc000976450>: 
    failed to create NodePool np-w5pt4m, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-w5pt4m in resource group rg-nightly-4-21-x7zgfd, error: failed waiting for nodepool="np-w5pt4m" for cluster "cluster-nightly-4-21-w5pt4m" in resourcegroup="rg-nightly-4-21-x7zgfd" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-w5pt4m" for cluster "cluster-nightly-4-21-w5pt4m"
Unexpected error:
    <*fmt.wrapErrors | 0xc000976450>: 
    failed to create NodePool np-w5pt4m, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-w5pt4m in resource group rg-nightly-4-21-x7zgfd, error: failed waiting for nodepool="np-w5pt4m" for cluster "cluster-nightly-4-21-w5pt4m" in resourcegroup="rg-nightly-4-21-x7zgfd" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:10 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-v2vrn5/cluster-nightly-4-23-qz5lb5 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001756060>: 
    failed waiting for cluster="cluster-nightly-4-23-qz5lb5" in resourcegroup="rg-nightly-4-23-v2vrn5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-qz5lb5 in resource group rg-nightly-4-23-v2vrn5, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-v2vrn5/cluster-nightly-4-23-qz5lb5 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001756060>: 
    failed waiting for cluster="cluster-nightly-4-23-qz5lb5" in resourcegroup="rg-nightly-4-23-v2vrn5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-qz5lb5 in resource group rg-nightly-4-23-v2vrn5, error: context deadline exceeded
    ...
occurred
ERROR CODE: InvalidTemplateDeployment; provider Microsoft.Compute
23:00:10 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:130]: failed to deploy test VM
Unexpected error:
    <*fmt.wrapError | 0xc000d273a0>: 
    failed creating deployment "test-vm" in resourcegroup="e2e-cidr-connectivity-9xbp9m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/e2e-cidr-connectivity-9xbp9m/providers/Microsoft.Resources/deployments/test-vm
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidTemplateDeployment
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidTemplateDeployment",
        "message": "The template deployment 'test-vm' is not valid according to the validation procedure. The following resource provider(s) - 'Microsoft.Compute/virtualMachines (2023-03-01)' reported preflight validation errors. Tracking id is '21503528-9017-4784-8156-8f2140dfcfce'. See inner errors for details.",
        "details": [
          {
            "code": "QuotaExceeded",
            "message": "Operation could not be completed as it results in exceeding approved standardDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: uksouth, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22uksouth%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:130]: failed to deploy test VM
Unexpected error:
    <*fmt.wrapError | 0xc000d273a0>: 
    failed creating deployment "test-vm" in resourcegroup="e2e-cidr-connectivity-9xbp9m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/e2e-cidr-connectivity-9xbp9m/providers/Microsoft.Resources/deployments/test-vm
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidTemplateDeployment
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidTemplateDeployment",
        "message": "The template deployment 'test-vm' is not valid according to the validation procedure. The following resource provider(s) - 'Microsoft.Compute/virtualMachines (2023-03-01)' reported preflight validation errors. Tracking id is '21503528-9017-4784-8156-8f2140dfcfce'. See inner errors for details.",
        "details": [
          {
            "code": "QuotaExceeded",
            "message": "Operation could not be completed as it results in exceeding approved standardDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: uksouth, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22uksouth%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
23:00:10 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc000cdec30>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-c6fj9w, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-c6fj9w" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc000cdec30>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-c6fj9w, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-c6fj9w" to finish creating: context deadline exceeded
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 9
e2e (9)
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:09 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-nr856v" for cluster "cluster-candidate-4-22-nr856v"
Unexpected error:
    <*fmt.wrapErrors | 0xc001560ea0>: 
    failed to create NodePool np-nr856v, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-nr856v in resource group rg-candidate-4-22-kvwqrp, error: failed waiting for nodepool="np-nr856v" for cluster "cluster-candidate-4-22-nr856v" in resourcegroup="rg-candidate-4-22-kvwqrp" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-nr856v" for cluster "cluster-candidate-4-22-nr856v"
Unexpected error:
    <*fmt.wrapErrors | 0xc001560ea0>: 
    failed to create NodePool np-nr856v, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-nr856v in resource group rg-candidate-4-22-kvwqrp, error: failed waiting for nodepool="np-nr856v" for cluster "cluster-candidate-4-22-nr856v" in resourcegroup="rg-candidate-4-22-kvwqrp" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:09 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-5qj9xq/cluster-nightly-5-0-r8slxc should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000694f90>: 
    failed waiting for cluster="cluster-nightly-5-0-r8slxc" in resourcegroup="rg-nightly-5-0-5qj9xq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-r8slxc in resource group rg-nightly-5-0-5qj9xq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-5qj9xq/cluster-nightly-5-0-r8slxc should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000694f90>: 
    failed waiting for cluster="cluster-nightly-5-0-r8slxc" in resourcegroup="rg-nightly-5-0-5qj9xq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-r8slxc in resource group rg-nightly-5-0-5qj9xq, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:09 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-xl2x7k/cluster-nightly-4-23-284n4g should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0009eca80>: 
    failed waiting for cluster="cluster-nightly-4-23-284n4g" in resourcegroup="rg-nightly-4-23-xl2x7k" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-284n4g in resource group rg-nightly-4-23-xl2x7k, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-xl2x7k/cluster-nightly-4-23-284n4g should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0009eca80>: 
    failed waiting for cluster="cluster-nightly-4-23-284n4g" in resourcegroup="rg-nightly-4-23-xl2x7k" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-284n4g in resource group rg-nightly-4-23-xl2x7k, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:09 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-7rrv95" for cluster "cluster-candidate-4-21-7rrv95"
Unexpected error:
    <*fmt.wrapErrors | 0xc001589c50>: 
    failed to create NodePool np-7rrv95, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-7rrv95 in resource group rg-candidate-4-21-l6w5vk, error: failed waiting for nodepool="np-7rrv95" for cluster "cluster-candidate-4-21-7rrv95" in resourcegroup="rg-candidate-4-21-l6w5vk" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-7rrv95" for cluster "cluster-candidate-4-21-7rrv95"
Unexpected error:
    <*fmt.wrapErrors | 0xc001589c50>: 
    failed to create NodePool np-7rrv95, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-7rrv95 in resource group rg-candidate-4-21-l6w5vk, error: failed waiting for nodepool="np-7rrv95" for cluster "cluster-candidate-4-21-7rrv95" in resourcegroup="rg-candidate-4-21-l6w5vk" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:09 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc000997bc0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-f29sdk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-f29sdk, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc000997bc0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-f29sdk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-f29sdk, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:09 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-mf4jwb" for cluster "cluster-candidate-4-20-mf4jwb"
Unexpected error:
    <*fmt.wrapErrors | 0xc00160d9e0>: 
    failed to create NodePool np-mf4jwb, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-mf4jwb in resource group rg-candidate-4-20-klb7dd, error: failed waiting for nodepool="np-mf4jwb" for cluster "cluster-candidate-4-20-mf4jwb" in resourcegroup="rg-candidate-4-20-klb7dd" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:192]: failed to create node pool "np-mf4jwb" for cluster "cluster-candidate-4-20-mf4jwb"
Unexpected error:
    <*fmt.wrapErrors | 0xc00160d9e0>: 
    failed to create NodePool np-mf4jwb, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-mf4jwb in resource group rg-candidate-4-20-klb7dd, error: failed waiting for nodepool="np-mf4jwb" for cluster "cluster-candidate-4-20-mf4jwb" in resourcegroup="rg-candidate-4-20-klb7dd" to finish creating: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:09 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-swzs7c
Unexpected error:
    <*fmt.wrapErrors | 0xc000c6c600>: 
    failed to create HCP cluster np-noedge-swzs7c, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-swzs7c in resource group rg-np-noedge-swzs7c-rxjz64, error: failed waiting for cluster="np-noedge-swzs7c" in resourcegroup="rg-np-noedge-swzs7c-rxjz64" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-swzs7c in resource group rg-np-noedge-swzs7c-rxjz64, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-swzs7c
Unexpected error:
    <*fmt.wrapErrors | 0xc000c6c600>: 
    failed to create HCP cluster np-noedge-swzs7c, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-swzs7c in resource group rg-np-noedge-swzs7c-rxjz64, error: failed waiting for cluster="np-noedge-swzs7c" in resourcegroup="rg-np-noedge-swzs7c-rxjz64" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-swzs7c in resource group rg-np-noedge-swzs7c-rxjz64, error: context deadline exceeded
    ...
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:09 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc000acac00>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-hnwh92, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-hnwh92" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc000acac00>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-hnwh92, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-hnwh92" to finish creating: context deadline exceeded
    ...
occurred
ERROR CODE: InvalidTemplateDeployment; provider Microsoft.Compute
02:00:09 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:130]: failed to deploy test VM
Unexpected error:
    <*fmt.wrapError | 0xc0000d5ae0>: 
    failed creating deployment "test-vm" in resourcegroup="e2e-cidr-connectivity-7ktm25": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/e2e-cidr-connectivity-7ktm25/providers/Microsoft.Resources/deployments/test-vm
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidTemplateDeployment
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidTemplateDeployment",
        "message": "The template deployment 'test-vm' is not valid according to the validation procedure. The following resource provider(s) - 'Microsoft.Compute/virtualMachines (2023-03-01)' reported preflight validation errors. Tracking id is 'df96e1a8-3336-4b6e-8a5f-4f6ea39c547e'. See inner errors for details.",
        "details": [
          {
            "code": "QuotaExceeded",
            "message": "Operation could not be completed as it results in exceeding approved standardDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: uksouth, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22uksouth%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:130]: failed to deploy test VM
Unexpected error:
    <*fmt.wrapError | 0xc0000d5ae0>: 
    failed creating deployment "test-vm" in resourcegroup="e2e-cidr-connectivity-7ktm25": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/e2e-cidr-connectivity-7ktm25/providers/Microsoft.Resources/deployments/test-vm
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidTemplateDeployment
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidTemplateDeployment",
        "message": "The template deployment 'test-vm' is not valid according to the validation procedure. The following resource provider(s) - 'Microsoft.Compute/virtualMachines (2023-03-01)' reported preflight validation errors. Tracking id is 'df96e1a8-3336-4b6e-8a5f-4f6ea39c547e'. See inner errors for details.",
        "details": [
          {
            "code": "QuotaExceeded",
            "message": "Operation could not be completed as it results in exceeding approved standardDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: uksouth, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22uksouth%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred