CIHealth Run Log

↗ Open Failure patterns for this day

Environment: STG

Time (UTC)	Job	Failed at	Result	PR	Failed tests	Details
23:00:15	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	6	e2e (6) CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 23:00:15 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc" Unexpected error: <fmt.wrapErrors \| 0xc00262b740>: failed to create NodePool np-rcm6vc, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-rcm6vc in resource group rg-nightly-4-22-7mbqqd, error: failed waiting for nodepool="np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc" in resourcegroup="rg-nightly-4-22-7mbqqd" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc" Unexpected error: <fmt.wrapErrors \| 0xc00262b740>: failed to create NodePool np-rcm6vc, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-rcm6vc in resource group rg-nightly-4-22-7mbqqd, error: failed waiting for nodepool="np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc" in resourcegroup="rg-nightly-4-22-7mbqqd" to finish creating: context deadline exceeded ... occurred error should indicate FIPS value must be true or false 23:00:15 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should reject an HCP cluster creation with invalid FIPS tag value · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false Expected <string>: ... to contain substring <string>: ... fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false Expected <string>: ... to contain substring <string>: ... CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 23:00:15 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92" Unexpected error: <fmt.wrapErrors \| 0xc0027de780>: failed to create NodePool np-8dgh92, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-8dgh92 in resource group rg-nightly-4-21-h9gcbw, error: failed waiting for nodepool="np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92" in resourcegroup="rg-nightly-4-21-h9gcbw" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92" Unexpected error: <fmt.wrapErrors \| 0xc0027de780>: failed to create NodePool np-8dgh92, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-8dgh92 in resource group rg-nightly-4-21-h9gcbw, error: failed waiting for nodepool="np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92" in resourcegroup="rg-nightly-4-21-h9gcbw" to finish creating: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 23:00:15 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-gcvzn7/cluster-nightly-4-23-cnr9gk should provision Unexpected error: <fmt.wrapErrors \| 0xc000ef6d20>: failed to create HCP cluster cluster-nightly-4-23-cnr9gk, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: failed waiting for cluster="cluster-nightly-4-23-cnr9gk" in resourcegroup="rg-nightly-4-23-gcvzn7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-gcvzn7/cluster-nightly-4-23-cnr9gk should provision Unexpected error: <fmt.wrapErrors \| 0xc000ef6d20>: failed to create HCP cluster cluster-nightly-4-23-cnr9gk, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: failed waiting for cluster="cluster-nightly-4-23-cnr9gk" in resourcegroup="rg-nightly-4-23-gcvzn7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: context deadline exceeded ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 23:00:15 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster" Unexpected error: <errors.joinError \| 0xc00158a468>: VerifyNodesReady failed: no nodes found in the cluster VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-xfd9v5, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-xfd9v5" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster" Unexpected error: <errors.joinError \| 0xc00158a468>: VerifyNodesReady failed: no nodes found in the cluster VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-xfd9v5, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-xfd9v5" to finish creating: context deadline exceeded ... occurred ERROR CODE: InvalidRequestContent; detail message Invalid value: "aro-hcp.experimental.cluster.fips-enabled": unrecognized experimental tag; provider Microsoft.RedHatOpenShift 23:00:15 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapError \| 0xc0006087e0>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-gxrnqc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-gxrnqc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag", "target": "tags[aro-hcp.experimental.cluster.fips-enabled]" } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapError \| 0xc0006087e0>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-gxrnqc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-gxrnqc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag", "target": "tags[aro-hcp.experimental.cluster.fips-enabled]" } } -------------------------------------------------------------------------------- ... occurred
02:00:13	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	6	e2e (6) CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 02:00:13 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster" Unexpected error: <errors.joinError \| 0xc002232438>: VerifyNodesReady failed: no nodes found in the cluster VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-ss6qtp, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-ss6qtp" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster" Unexpected error: <errors.joinError \| 0xc002232438>: VerifyNodesReady failed: no nodes found in the cluster VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-ss6qtp, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-ss6qtp" to finish creating: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 02:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-2m66wl/cluster-candidate-4-22-9r2jlz should provision Unexpected error: <fmt.wrapErrors \| 0xc0004c0090>: failed to create HCP cluster cluster-candidate-4-22-9r2jlz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: failed waiting for cluster="cluster-candidate-4-22-9r2jlz" in resourcegroup="rg-candidate-4-22-2m66wl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-2m66wl/cluster-candidate-4-22-9r2jlz should provision Unexpected error: <fmt.wrapErrors \| 0xc0004c0090>: failed to create HCP cluster cluster-candidate-4-22-9r2jlz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: failed waiting for cluster="cluster-candidate-4-22-9r2jlz" in resourcegroup="rg-candidate-4-22-2m66wl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: context deadline exceeded ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 02:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9" Unexpected error: <fmt.wrapErrors \| 0xc002a8b740>: failed to create NodePool np-dkdnz9, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-dkdnz9 in resource group rg-candidate-4-21-fmqlhk, error: failed waiting for nodepool="np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9" in resourcegroup="rg-candidate-4-21-fmqlhk" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9" Unexpected error: <fmt.wrapErrors \| 0xc002a8b740>: failed to create NodePool np-dkdnz9, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-dkdnz9 in resource group rg-candidate-4-21-fmqlhk, error: failed waiting for nodepool="np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9" in resourcegroup="rg-candidate-4-21-fmqlhk" to finish creating: context deadline exceeded ... occurred error should indicate FIPS value must be true or false 02:00:13 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should reject an HCP cluster creation with invalid FIPS tag value · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false Expected <string>: ... to contain substring <string>: ... fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false Expected <string>: ... to contain substring <string>: ... timeout during CreateHCPClusterAndWait; context deadline exceeded 02:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-f2qtcx/cluster-candidate-5-0-vwsc5p should provision Unexpected error: <fmt.wrapErrors \| 0xc000a82ae0>: failed to create HCP cluster cluster-candidate-5-0-vwsc5p, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: failed waiting for cluster="cluster-candidate-5-0-vwsc5p" in resourcegroup="rg-candidate-5-0-f2qtcx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-f2qtcx/cluster-candidate-5-0-vwsc5p should provision Unexpected error: <fmt.wrapErrors \| 0xc000a82ae0>: failed to create HCP cluster cluster-candidate-5-0-vwsc5p, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: failed waiting for cluster="cluster-candidate-5-0-vwsc5p" in resourcegroup="rg-candidate-5-0-f2qtcx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: context deadline exceeded ... occurred ERROR CODE: InvalidRequestContent; detail message Invalid value: "aro-hcp.experimental.cluster.fips-enabled": unrecognized experimental tag; provider Microsoft.RedHatOpenShift 02:00:13 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapError \| 0xc000cc0820>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-nx2jwf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-nx2jwf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag", "target": "tags[aro-hcp.experimental.cluster.fips-enabled]" } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapError \| 0xc000cc0820>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-nx2jwf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-nx2jwf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag", "target": "tags[aro-hcp.experimental.cluster.fips-enabled]" } } -------------------------------------------------------------------------------- ... occurred

Time (UTC)

Job

Failed at

Result

Failed tests

Details

23:00:15

periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly

post-goodmerged PR

No additional run metadata captured

e2e

failed

n/a

e2e (6)

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

23:00:15 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc"
Unexpected error:
    <*fmt.wrapErrors | 0xc00262b740>: 
    failed to create NodePool np-rcm6vc, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-rcm6vc in resource group rg-nightly-4-22-7mbqqd, error: failed waiting for nodepool="np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc" in resourcegroup="rg-nightly-4-22-7mbqqd" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc"
Unexpected error:
    <*fmt.wrapErrors | 0xc00262b740>: 
    failed to create NodePool np-rcm6vc, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-rcm6vc in resource group rg-nightly-4-22-7mbqqd, error: failed waiting for nodepool="np-rcm6vc" for cluster "cluster-nightly-4-22-rcm6vc" in resourcegroup="rg-nightly-4-22-7mbqqd" to finish creating: context deadline exceeded
    ...
occurred

error should indicate FIPS value must be true or false

23:00:15 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should reject an HCP cluster creation with invalid FIPS tag value · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false
Expected
    <string>: ...
to contain substring
    <string>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false
Expected
    <string>: ...
to contain substring
    <string>: ...

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

23:00:15 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.21 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92"
Unexpected error:
    <*fmt.wrapErrors | 0xc0027de780>: 
    failed to create NodePool np-8dgh92, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-8dgh92 in resource group rg-nightly-4-21-h9gcbw, error: failed waiting for nodepool="np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92" in resourcegroup="rg-nightly-4-21-h9gcbw" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92"
Unexpected error:
    <*fmt.wrapErrors | 0xc0027de780>: 
    failed to create NodePool np-8dgh92, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-8dgh92 in resource group rg-nightly-4-21-h9gcbw, error: failed waiting for nodepool="np-8dgh92" for cluster "cluster-nightly-4-21-8dgh92" in resourcegroup="rg-nightly-4-21-h9gcbw" to finish creating: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

23:00:15 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-gcvzn7/cluster-nightly-4-23-cnr9gk should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000ef6d20>: 
    failed to create HCP cluster cluster-nightly-4-23-cnr9gk, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: failed waiting for cluster="cluster-nightly-4-23-cnr9gk" in resourcegroup="rg-nightly-4-23-gcvzn7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-4-23-gcvzn7/cluster-nightly-4-23-cnr9gk should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000ef6d20>: 
    failed to create HCP cluster cluster-nightly-4-23-cnr9gk, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: failed waiting for cluster="cluster-nightly-4-23-cnr9gk" in resourcegroup="rg-nightly-4-23-gcvzn7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-4-23-cnr9gk in resource group rg-nightly-4-23-gcvzn7, error: context deadline exceeded
    ...
occurred

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

23:00:15 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc00158a468>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-xfd9v5, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-xfd9v5" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc00158a468>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-xfd9v5, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-xfd9v5" to finish creating: context deadline exceeded
    ...
occurred

ERROR CODE: InvalidRequestContent; detail message Invalid value: "aro-hcp.experimental.cluster.fips-enabled": unrecognized experimental tag; provider Microsoft.RedHatOpenShift

23:00:15 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0006087e0>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-gxrnqc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-gxrnqc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0006087e0>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-gxrnqc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-gxrnqc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred

02:00:13

periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel

post-goodmerged PR

No additional run metadata captured

e2e

failed

n/a

e2e (6)

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

02:00:13 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc002232438>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-ss6qtp, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-ss6qtp" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc002232438>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-ss6qtp, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-ss6qtp" to finish creating: context deadline exceeded
    ...
occurred

timeout during CreateHCPClusterAndWait; context deadline exceeded

02:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-2m66wl/cluster-candidate-4-22-9r2jlz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0004c0090>: 
    failed to create HCP cluster cluster-candidate-4-22-9r2jlz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: failed waiting for cluster="cluster-candidate-4-22-9r2jlz" in resourcegroup="rg-candidate-4-22-2m66wl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-2m66wl/cluster-candidate-4-22-9r2jlz should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0004c0090>: 
    failed to create HCP cluster cluster-candidate-4-22-9r2jlz, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: failed waiting for cluster="cluster-candidate-4-22-9r2jlz" in resourcegroup="rg-candidate-4-22-2m66wl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-9r2jlz in resource group rg-candidate-4-22-2m66wl, error: context deadline exceeded
    ...
occurred

CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded

02:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9"
Unexpected error:
    <*fmt.wrapErrors | 0xc002a8b740>: 
    failed to create NodePool np-dkdnz9, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-dkdnz9 in resource group rg-candidate-4-21-fmqlhk, error: failed waiting for nodepool="np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9" in resourcegroup="rg-candidate-4-21-fmqlhk" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9"
Unexpected error:
    <*fmt.wrapErrors | 0xc002a8b740>: 
    failed to create NodePool np-dkdnz9, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-dkdnz9 in resource group rg-candidate-4-21-fmqlhk, error: failed waiting for nodepool="np-dkdnz9" for cluster "cluster-candidate-4-21-dkdnz9" in resourcegroup="rg-candidate-4-21-fmqlhk" to finish creating: context deadline exceeded
    ...
occurred

error should indicate FIPS value must be true or false

02:00:13 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should reject an HCP cluster creation with invalid FIPS tag value · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false
Expected
    <string>: ...
to contain substring
    <string>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false
Expected
    <string>: ...
to contain substring
    <string>: ...

timeout during CreateHCPClusterAndWait; context deadline exceeded

02:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-f2qtcx/cluster-candidate-5-0-vwsc5p should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a82ae0>: 
    failed to create HCP cluster cluster-candidate-5-0-vwsc5p, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: failed waiting for cluster="cluster-candidate-5-0-vwsc5p" in resourcegroup="rg-candidate-5-0-f2qtcx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-f2qtcx/cluster-candidate-5-0-vwsc5p should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a82ae0>: 
    failed to create HCP cluster cluster-candidate-5-0-vwsc5p, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: failed waiting for cluster="cluster-candidate-5-0-vwsc5p" in resourcegroup="rg-candidate-5-0-f2qtcx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-vwsc5p in resource group rg-candidate-5-0-f2qtcx, error: context deadline exceeded
    ...
occurred

ERROR CODE: InvalidRequestContent; detail message Invalid value: "aro-hcp.experimental.cluster.fips-enabled": unrecognized experimental tag; provider Microsoft.RedHatOpenShift

02:00:13 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite stage/parallel

Show raw failure

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc000cc0820>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-nx2jwf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-nx2jwf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc000cc0820>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-nx2jwf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-nx2jwf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred