CIHealth Run Log

CIHealth

↗ Open Failure patterns for this day

Environment: STG

Time (UTC)

Job

Failed at

Result

PR

Failed tests

Details

23:00:22

periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly

post-goodmerged PR

No additional run metadata captured

e2e

failed

n/a

7

e2e (7)

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc0009b0060>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-fwjgxt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-fwjgxt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapErrors | 0xc0009b0060>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-fwjgxt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-fwjgxt, error: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-8d99cm/cluster-nightly-4-23-xvs9q7 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001640270>: 
    failed to create HCP cluster cluster-nightly-4-23-xvs9q7, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-xvs9q7 in resource group rg-nightly-4-23-8d99cm, error: failed waiting for cluster="cluster-nightly-4-23-xvs9q7" in resourcegroup="rg-nightly-4-23-8d99cm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-xvs9q7 in resource group rg-nightly-4-23-8d99cm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-8d99cm/cluster-nightly-4-23-xvs9q7 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001640270>: 
    failed to create HCP cluster cluster-nightly-4-23-xvs9q7, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-xvs9q7 in resource group rg-nightly-4-23-8d99cm, error: failed waiting for cluster="cluster-nightly-4-23-xvs9q7" in resourcegroup="rg-nightly-4-23-8d99cm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-xvs9q7 in resource group rg-nightly-4-23-8d99cm, error: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.20 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-20-62wbr7/cluster-nightly-4-20-pxrtxn should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000866480>: 
    failed to create HCP cluster cluster-nightly-4-20-pxrtxn, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-pxrtxn in resource group rg-nightly-4-20-62wbr7, error: failed waiting for cluster="cluster-nightly-4-20-pxrtxn" in resourcegroup="rg-nightly-4-20-62wbr7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-pxrtxn in resource group rg-nightly-4-20-62wbr7, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-20-62wbr7/cluster-nightly-4-20-pxrtxn should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000866480>: 
    failed to create HCP cluster cluster-nightly-4-20-pxrtxn, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-pxrtxn in resource group rg-nightly-4-20-62wbr7, error: failed waiting for cluster="cluster-nightly-4-20-pxrtxn" in resourcegroup="rg-nightly-4-20-62wbr7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-20-pxrtxn in resource group rg-nightly-4-20-62wbr7, error: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:97]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc002916060>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-ztk9jr, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-ztk9jr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-ztk9jr, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:97]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc002916060>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-ztk9jr, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-ztk9jr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-ztk9jr, error: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-22-858hzm/cluster-nightly-4-22-xcdlzz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001162390>: 
    failed to create HCP cluster cluster-nightly-4-22-xcdlzz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-22-xcdlzz in resource group rg-nightly-4-22-858hzm, error: failed waiting for cluster="cluster-nightly-4-22-xcdlzz" in resourcegroup="rg-nightly-4-22-858hzm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-22-xcdlzz in resource group rg-nightly-4-22-858hzm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-22-858hzm/cluster-nightly-4-22-xcdlzz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001162390>: 
    failed to create HCP cluster cluster-nightly-4-22-xcdlzz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-22-xcdlzz in resource group rg-nightly-4-22-858hzm, error: failed waiting for cluster="cluster-nightly-4-22-xcdlzz" in resourcegroup="rg-nightly-4-22-858hzm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-22-xcdlzz in resource group rg-nightly-4-22-858hzm, error: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapErrors | 0xc0012fc3c0>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-djn9rt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-djn9rt, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapErrors | 0xc0012fc3c0>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-djn9rt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-djn9rt, error: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:22 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI
Unexpected error:
    <*fmt.wrapErrors | 0xc001308660>: 
    failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-kjptnb, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-kjptnb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-kjptnb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI
Unexpected error:
    <*fmt.wrapErrors | 0xc001308660>: 
    failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-kjptnb, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-kjptnb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-kjptnb, error: context deadline exceeded
    ...
occurred

14:54:46

branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel

post-goodmerged PR

No additional run metadata captured

n/a

passed

n/a

0

n/a

02:00:22

periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel

post-goodmerged PR

No additional run metadata captured

e2e

failed

n/a

3

e2e (3)

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

02:00:22 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:214]: failed to create no-AZ nodepool autoscale-noaz with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc001c73d10>: 
    failed to create NodePool autoscale-noaz, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-noaz in resource group np-autoscaling-bxgl8t, error: failed waiting for nodepool="autoscale-noaz" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-bxgl8t" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:214]: failed to create no-AZ nodepool autoscale-noaz with autoscaling
Unexpected error:
    <*fmt.wrapErrors | 0xc001c73d10>: 
    failed to create NodePool autoscale-noaz, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-noaz in resource group np-autoscaling-bxgl8t, error: failed waiting for nodepool="autoscale-noaz" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-bxgl8t" to finish creating: context deadline exceeded
    ...
occurred

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

02:00:22 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:168]: failed to create node pool np-1
Unexpected error:
    <*fmt.wrapErrors | 0xc0026879e0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group rg-negative-tests-7584j7, error: failed waiting for nodepool="np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-7584j7" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:168]: failed to create node pool np-1
Unexpected error:
    <*fmt.wrapErrors | 0xc0026879e0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group rg-negative-tests-7584j7, error: failed waiting for nodepool="np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-7584j7" to finish creating: context deadline exceeded
    ...
occurred

failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled

02:00:22 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0020020f0>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cilium-cl" in resourcegroup="cni-cilium-v7fdgp" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0020020f0>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cilium-cl" in resourcegroup="cni-cilium-v7fdgp" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred