CIHealth Run Log

Environment: PROD

Time (UTC)	Job	Failed at	Result	PR	Failed tests	Details
23:00:03	periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	3	e2e (3) ERROR CODE: InvalidRequestContent; detail message Version 'openshift-v<version>' doesn't exist; provider Microsoft.RedHatOpenShift 23:00:03 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:704]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000aa92e0>: failed to create HCP cluster np-dg-minor-cqhmp9: failed starting cluster creation "np-dg-minor-cqhmp9" in resourcegroup="rg-np-dg-minor-cqhmp9-ksrc76": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-cqhmp9-ksrc76/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-cqhmp9 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Version 'openshift-v4.21.0-nightly' doesn't exist" } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:704]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000aa92e0>: failed to create HCP cluster np-dg-minor-cqhmp9: failed starting cluster creation "np-dg-minor-cqhmp9" in resourcegroup="rg-np-dg-minor-cqhmp9-ksrc76": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-cqhmp9-ksrc76/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-cqhmp9 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Version 'openshift-v4.21.0-nightly' doesn't exist" } } -------------------------------------------------------------------------------- ... occurred tls: failed to verify certificate: x509: certificate signed by unknown authority 23:00:03 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.0 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:205]: failed to verify simple web app runs on cluster "cluster-nightly-5-0-49vmww" Unexpected error: <fmt.wrapError \| 0xc0000d5080>: route was never reachable: Get "https://agnhost-e2e-serving-app-h7tkh.apps.aro.g5x8x9n2r7b0d4z.mce0.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:205]: failed to verify simple web app runs on cluster "cluster-nightly-5-0-49vmww" Unexpected error: <fmt.wrapError \| 0xc0000d5080>: route was never reachable: Get "https://agnhost-e2e-serving-app-h7tkh.apps.aro.g5x8x9n2r7b0d4z.mce0.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority ... occurred ERROR CODE: InvalidRequestContent; detail message Version 'openshift-v<version>' doesn't exist; provider Microsoft.RedHatOpenShift 23:00:03 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:443]: failed to create HCP cluster np-skip-minor-msdg4x at version 4.22.0 Unexpected error: <fmt.wrapError \| 0xc000f7aa80>: failed to create HCP cluster np-skip-minor-msdg4x: failed starting cluster creation "np-skip-minor-msdg4x" in resourcegroup="rg-np-skip-minor-msdg4x-77vm7v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-msdg4x-77vm7v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-msdg4x -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Version 'openshift-v4.22.0-nightly' doesn't exist" } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:443]: failed to create HCP cluster np-skip-minor-msdg4x at version 4.22.0 Unexpected error: <fmt.wrapError \| 0xc000f7aa80>: failed to create HCP cluster np-skip-minor-msdg4x: failed starting cluster creation "np-skip-minor-msdg4x" in resourcegroup="rg-np-skip-minor-msdg4x-77vm7v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-msdg4x-77vm7v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-msdg4x -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Version 'openshift-v4.22.0-nightly' doesn't exist" } } -------------------------------------------------------------------------------- ... occurred
19:05:20	branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	49	e2e (49) timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:704]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc000fa89f0>: failed to create HCP cluster np-dg-minor-4vnvf9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-4vnvf9 in resource group rg-np-dg-minor-4vnvf9-6gcm7b, error: failed waiting for cluster="np-dg-minor-4vnvf9" in resourcegroup="rg-np-dg-minor-4vnvf9-6gcm7b" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-4vnvf9 in resource group rg-np-dg-minor-4vnvf9-6gcm7b, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:704]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc000fa89f0>: failed to create HCP cluster np-dg-minor-4vnvf9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-4vnvf9 in resource group rg-np-dg-minor-4vnvf9-6gcm7b, error: failed waiting for cluster="np-dg-minor-4vnvf9" in resourcegroup="rg-np-dg-minor-4vnvf9-6gcm7b" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-4vnvf9 in resource group rg-np-dg-minor-4vnvf9-6gcm7b, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapErrors \| 0xc0010d10b0>: failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-hrpln7, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-hrpln7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-hrpln7, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapErrors \| 0xc0010d10b0>: failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-hrpln7, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-hrpln7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-hrpln7, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:89]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc0016046c0>: failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-4q9xtk, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-4q9xtk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-4q9xtk, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:89]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc0016046c0>: failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-4q9xtk, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-4q9xtk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-4q9xtk, error: context deadline exceeded ... occurred Interrupted by User 19:05:20 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:39]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:39]: Interrupted by User timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-20-gnd5lv" with version 4.20.23 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc0016402d0>: failed to create HCP cluster cluster-zstream-4-20-gnd5lv, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gnd5lv in resource group rg-zstream-upgrade-4-20-gnldsw, error: failed waiting for cluster="cluster-zstream-4-20-gnd5lv" in resourcegroup="rg-zstream-upgrade-4-20-gnldsw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gnd5lv in resource group rg-zstream-upgrade-4-20-gnldsw, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-20-gnd5lv" with version 4.20.23 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc0016402d0>: failed to create HCP cluster cluster-zstream-4-20-gnd5lv, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gnd5lv in resource group rg-zstream-upgrade-4-20-gnldsw, error: failed waiting for cluster="cluster-zstream-4-20-gnd5lv" in resourcegroup="rg-zstream-upgrade-4-20-gnldsw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gnd5lv in resource group rg-zstream-upgrade-4-20-gnldsw, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapErrors \| 0xc00082bef0>: failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wgxtkt, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-wgxtkt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wgxtkt, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapErrors \| 0xc00082bef0>: failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wgxtkt, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-wgxtkt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wgxtkt, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:443]: failed to create HCP cluster np-skip-minor-frpph8 at version 4.22.0-rc.5 Unexpected error: <fmt.wrapErrors \| 0xc00097ce10>: failed to create HCP cluster np-skip-minor-frpph8, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-frpph8 in resource group rg-np-skip-minor-frpph8-mb86nl, error: failed waiting for cluster="np-skip-minor-frpph8" in resourcegroup="rg-np-skip-minor-frpph8-mb86nl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-frpph8 in resource group rg-np-skip-minor-frpph8-mb86nl, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:443]: failed to create HCP cluster np-skip-minor-frpph8 at version 4.22.0-rc.5 Unexpected error: <fmt.wrapErrors \| 0xc00097ce10>: failed to create HCP cluster np-skip-minor-frpph8, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-frpph8 in resource group rg-np-skip-minor-frpph8-mb86nl, error: failed waiting for cluster="np-skip-minor-frpph8" in resourcegroup="rg-np-skip-minor-frpph8-mb86nl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-frpph8 in resource group rg-np-skip-minor-frpph8-mb86nl, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapErrors \| 0xc001593410>: failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-ld957v, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-ld957v" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-ld957v, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapErrors \| 0xc001593410>: failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-ld957v, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-ld957v" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-ld957v, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapErrors \| 0xc001028900>: failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-f27v7g, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-f27v7g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-f27v7g, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapErrors \| 0xc001028900>: failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-f27v7g, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-f27v7g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-f27v7g, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:573]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc0009b86f0>: failed to create HCP cluster np-downgrade-8blxr6, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-8blxr6 in resource group rg-np-downgrade-8blxr6-xntzlh, error: failed waiting for cluster="np-downgrade-8blxr6" in resourcegroup="rg-np-downgrade-8blxr6-xntzlh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-8blxr6 in resource group rg-np-downgrade-8blxr6-xntzlh, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:573]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc0009b86f0>: failed to create HCP cluster np-downgrade-8blxr6, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-8blxr6 in resource group rg-np-downgrade-8blxr6-xntzlh, error: failed waiting for cluster="np-downgrade-8blxr6" in resourcegroup="rg-np-downgrade-8blxr6-xntzlh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-8blxr6 in resource group rg-np-downgrade-8blxr6-xntzlh, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:83]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapErrors \| 0xc001804900>: failed to create HCP cluster ea-list9hnrgw, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9hnrgw in resource group ea-list-pbqt7h, error: failed waiting for cluster="ea-list9hnrgw" in resourcegroup="ea-list-pbqt7h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9hnrgw in resource group ea-list-pbqt7h, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:83]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapErrors \| 0xc001804900>: failed to create HCP cluster ea-list9hnrgw, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9hnrgw in resource group ea-list-pbqt7h, error: failed waiting for cluster="ea-list9hnrgw" in resourcegroup="ea-list-pbqt7h" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list9hnrgw in resource group ea-list-pbqt7h, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-21-zw68hz" with version 4.21.17 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc000a68de0>: failed to create HCP cluster cluster-zstream-4-21-zw68hz, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-zw68hz in resource group rg-zstream-upgrade-4-21-dbqcpz, error: failed waiting for cluster="cluster-zstream-4-21-zw68hz" in resourcegroup="rg-zstream-upgrade-4-21-dbqcpz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-zw68hz in resource group rg-zstream-upgrade-4-21-dbqcpz, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-21-zw68hz" with version 4.21.17 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc000a68de0>: failed to create HCP cluster cluster-zstream-4-21-zw68hz, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-zw68hz in resource group rg-zstream-upgrade-4-21-dbqcpz, error: failed waiting for cluster="cluster-zstream-4-21-zw68hz" in resourcegroup="rg-zstream-upgrade-4-21-dbqcpz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-zw68hz in resource group rg-zstream-upgrade-4-21-dbqcpz, error: context deadline exceeded ... occurred Interrupted by User 19:05:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:207]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:207]: Interrupted by User timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-fw4cnj with version 4.20.24 Unexpected error: <fmt.wrapErrors \| 0xc000b5b9b0>: failed to create HCP cluster np-version-upgrade-cluster-fw4cnj, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fw4cnj in resource group rg-np-version-upgrade-fw4cnj-99928f, error: failed waiting for cluster="np-version-upgrade-cluster-fw4cnj" in resourcegroup="rg-np-version-upgrade-fw4cnj-99928f" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fw4cnj in resource group rg-np-version-upgrade-fw4cnj-99928f, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-fw4cnj with version 4.20.24 Unexpected error: <fmt.wrapErrors \| 0xc000b5b9b0>: failed to create HCP cluster np-version-upgrade-cluster-fw4cnj, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fw4cnj in resource group rg-np-version-upgrade-fw4cnj-99928f, error: failed waiting for cluster="np-version-upgrade-cluster-fw4cnj" in resourcegroup="rg-np-version-upgrade-fw4cnj-99928f" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-fw4cnj in resource group rg-np-version-upgrade-fw4cnj-99928f, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:158]: failed to create HCP cluster "cp-ystream-upgrade-4-21-8r5rqn" with install version 4.20.24 Unexpected error: <fmt.wrapErrors \| 0xc000eccdb0>: failed to create HCP cluster cp-ystream-upgrade-4-21-8r5rqn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-8r5rqn in resource group rg-cp-ystream-upgrade-4-21-hf7xvk, error: failed waiting for cluster="cp-ystream-upgrade-4-21-8r5rqn" in resourcegroup="rg-cp-ystream-upgrade-4-21-hf7xvk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-8r5rqn in resource group rg-cp-ystream-upgrade-4-21-hf7xvk, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:158]: failed to create HCP cluster "cp-ystream-upgrade-4-21-8r5rqn" with install version 4.20.24 Unexpected error: <fmt.wrapErrors \| 0xc000eccdb0>: failed to create HCP cluster cp-ystream-upgrade-4-21-8r5rqn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-8r5rqn in resource group rg-cp-ystream-upgrade-4-21-hf7xvk, error: failed waiting for cluster="cp-ystream-upgrade-4-21-8r5rqn" in resourcegroup="rg-cp-ystream-upgrade-4-21-hf7xvk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-21-8r5rqn in resource group rg-cp-ystream-upgrade-4-21-hf7xvk, error: context deadline exceeded ... occurred failed to wait for first cluster "<cluster>" to complete creation 19:05:20 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation Unexpected error: <context.deadlineExceededError>: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation Unexpected error: <context.deadlineExceededError>: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapErrors \| 0xc0014edd70>: failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-65tds8, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-65tds8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-65tds8, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapErrors \| 0xc0014edd70>: failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-65tds8, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-65tds8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-65tds8, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc0009aea20>: failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-tz2mt5, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-tz2mt5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-tz2mt5, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc0009aea20>: failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-tz2mt5, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-tz2mt5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-tz2mt5, error: context deadline exceeded ... occurred cluster has not yet reached Succeeded state 19:05:20 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.009s. cluster should eventually succeed after role assignments are created The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with: cluster has not yet reached Succeeded state Expected <armredhatopenshifthcp.ProvisioningState>: ... to equal <armredhatopenshifthcp.ProvisioningState>: ... fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.009s. cluster should eventually succeed after role assignments are created The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with: cluster has not yet reached Succeeded state Expected <armredhatopenshifthcp.ProvisioningState>: ... to equal <armredhatopenshifthcp.ProvisioningState>: ... timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-7ff4zf Unexpected error: <fmt.wrapErrors \| 0xc000722390>: failed to create HCP cluster np-noedge-7ff4zf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-7ff4zf in resource group rg-np-noedge-7ff4zf-q5wgtc, error: failed waiting for cluster="np-noedge-7ff4zf" in resourcegroup="rg-np-noedge-7ff4zf-q5wgtc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-7ff4zf in resource group rg-np-noedge-7ff4zf-q5wgtc, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-7ff4zf Unexpected error: <fmt.wrapErrors \| 0xc000722390>: failed to create HCP cluster np-noedge-7ff4zf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-7ff4zf in resource group rg-np-noedge-7ff4zf-q5wgtc, error: failed waiting for cluster="np-noedge-7ff4zf" in resourcegroup="rg-np-noedge-7ff4zf-q5wgtc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-7ff4zf in resource group rg-np-noedge-7ff4zf-q5wgtc, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-zb82xt with version 4.21.18 Unexpected error: <fmt.wrapErrors \| 0xc0013c4ae0>: failed to create HCP cluster np-version-upgrade-cluster-zb82xt, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zb82xt in resource group rg-np-version-upgrade-zb82xt-5l6kp9, error: failed waiting for cluster="np-version-upgrade-cluster-zb82xt" in resourcegroup="rg-np-version-upgrade-zb82xt-5l6kp9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zb82xt in resource group rg-np-version-upgrade-zb82xt-5l6kp9, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-zb82xt with version 4.21.18 Unexpected error: <fmt.wrapErrors \| 0xc0013c4ae0>: failed to create HCP cluster np-version-upgrade-cluster-zb82xt, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zb82xt in resource group rg-np-version-upgrade-zb82xt-5l6kp9, error: failed waiting for cluster="np-version-upgrade-cluster-zb82xt" in resourcegroup="rg-np-version-upgrade-zb82xt-5l6kp9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-zb82xt in resource group rg-np-version-upgrade-zb82xt-5l6kp9, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapErrors \| 0xc00211e2d0>: failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-nj5gjg, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-nj5gjg" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-nj5gjg, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapErrors \| 0xc00211e2d0>: failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-nj5gjg, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-nj5gjg" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-nj5gjg, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should update NodeDrainTimeoutMinutes and upgrade a nodepool · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_drain_timeout_update.go:102]: failed to create HCP cluster with version 4.20.24 Unexpected error: <fmt.wrapErrors \| 0xc001442300>: failed to create HCP cluster np-drain-timeout-and-upgrade-7nzmcb, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-drain-timeout-and-upgrade-7nzmcb in resource group rg-np-drain-timeout-and-upgrade-7nzmcb-5ll68c, error: failed waiting for cluster="np-drain-timeout-and-upgrade-7nzmcb" in resourcegroup="rg-np-drain-timeout-and-upgrade-7nzmcb-5ll68c" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-drain-timeout-and-upgrade-7nzmcb in resource group rg-np-drain-timeout-and-upgrade-7nzmcb-5ll68c, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_drain_timeout_update.go:102]: failed to create HCP cluster with version 4.20.24 Unexpected error: <fmt.wrapErrors \| 0xc001442300>: failed to create HCP cluster np-drain-timeout-and-upgrade-7nzmcb, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-drain-timeout-and-upgrade-7nzmcb in resource group rg-np-drain-timeout-and-upgrade-7nzmcb-5ll68c, error: failed waiting for cluster="np-drain-timeout-and-upgrade-7nzmcb" in resourcegroup="rg-np-drain-timeout-and-upgrade-7nzmcb-5ll68c" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-drain-timeout-and-upgrade-7nzmcb in resource group rg-np-drain-timeout-and-upgrade-7nzmcb-5ll68c, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test MISE Routing routes to the correct frontend based on version header MISE v2 when x-ms-mise-version header is set · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc0009be090>: failed waiting for cluster="mise-routing" in resourcegroup="mise-v2-smoke-gchwj4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-v2-smoke-gchwj4, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc0009be090>: failed waiting for cluster="mise-routing" in resourcegroup="mise-v2-smoke-gchwj4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-v2-smoke-gchwj4, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:134]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapErrors \| 0xc0013c42a0>: failed to create HCP cluster cidr-connectivity-test, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-kbzgjt, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-kbzgjt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-kbzgjt, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:134]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapErrors \| 0xc0013c42a0>: failed to create HCP cluster cidr-connectivity-test, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-kbzgjt, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-kbzgjt" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-kbzgjt, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:266]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapErrors \| 0xc0010468d0>: failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-lmjs6c, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-lmjs6c" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-lmjs6c, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:266]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapErrors \| 0xc0010468d0>: failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-lmjs6c, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-lmjs6c" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-lmjs6c, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.19 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-19-jpxjhf" with version 4.19.31 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc0004b0300>: failed to create HCP cluster cluster-zstream-4-19-jpxjhf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-jpxjhf in resource group rg-zstream-upgrade-4-19-wrjp6n, error: failed waiting for cluster="cluster-zstream-4-19-jpxjhf" in resourcegroup="rg-zstream-upgrade-4-19-wrjp6n" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-jpxjhf in resource group rg-zstream-upgrade-4-19-wrjp6n, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-19-jpxjhf" with version 4.19.31 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc0004b0300>: failed to create HCP cluster cluster-zstream-4-19-jpxjhf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-jpxjhf in resource group rg-zstream-upgrade-4-19-wrjp6n, error: failed waiting for cluster="cluster-zstream-4-19-jpxjhf" in resourcegroup="rg-zstream-upgrade-4-19-wrjp6n" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-jpxjhf in resource group rg-zstream-upgrade-4-19-wrjp6n, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapErrors \| 0xc0011b40c0>: failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-h27p4v, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-h27p4v" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-h27p4v, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapErrors \| 0xc0011b40c0>: failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-h27p4v, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-h27p4v" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-h27p4v, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-22-rc9frx/cluster-candidate-4-22-vc4ckf should provision Unexpected error: <fmt.wrapErrors \| 0xc0015b6bd0>: failed to create HCP cluster cluster-candidate-4-22-vc4ckf, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-vc4ckf in resource group rg-candidate-4-22-rc9frx, error: failed waiting for cluster="cluster-candidate-4-22-vc4ckf" in resourcegroup="rg-candidate-4-22-rc9frx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-vc4ckf in resource group rg-candidate-4-22-rc9frx, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-22-rc9frx/cluster-candidate-4-22-vc4ckf should provision Unexpected error: <fmt.wrapErrors \| 0xc0015b6bd0>: failed to create HCP cluster cluster-candidate-4-22-vc4ckf, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-vc4ckf in resource group rg-candidate-4-22-rc9frx, error: failed waiting for cluster="cluster-candidate-4-22-vc4ckf" in resourcegroup="rg-candidate-4-22-rc9frx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-vc4ckf in resource group rg-candidate-4-22-rc9frx, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapErrors \| 0xc0011d0b10>: failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-zr6z2l, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-zr6z2l" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-zr6z2l, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapErrors \| 0xc0011d0b10>: failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-zr6z2l, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-zr6z2l" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-zr6z2l, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapErrors \| 0xc0015d42d0>: failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-wpnnqs, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-wpnnqs" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-wpnnqs, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapErrors \| 0xc0015d42d0>: failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-wpnnqs, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-wpnnqs" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-wpnnqs, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapErrors \| 0xc001388480>: failed to create HCP cluster basic-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-sv69fc, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-sv69fc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-sv69fc, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapErrors \| 0xc001388480>: failed to create HCP cluster basic-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-sv69fc, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-sv69fc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-sv69fc, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapErrors \| 0xc0012d0f90>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-btj5dr, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-btj5dr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-btj5dr, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapErrors \| 0xc0012d0f90>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-btj5dr, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-btj5dr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-btj5dr, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:282]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapErrors \| 0xc00070a8a0>: failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-mtb25g, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-mtb25g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-mtb25g, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:282]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapErrors \| 0xc00070a8a0>: failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-mtb25g, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-mtb25g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-mtb25g, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapErrors \| 0xc0008f0300>: failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-mr4pxv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-mr4pxv, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapErrors \| 0xc0008f0300>: failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-mr4pxv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-mr4pxv, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:148]: failed to create HCP cluster version 4.19 Unexpected error: <fmt.wrapErrors \| 0xc000f0e8a0>: failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-9fm5jd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-9fm5jd, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:148]: failed to create HCP cluster version 4.19 Unexpected error: <fmt.wrapErrors \| 0xc000f0e8a0>: failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-9fm5jd" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-9fm5jd, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapErrors \| 0xc000f6e300>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-8s57cb, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-8s57cb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-8s57cb, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapErrors \| 0xc000f6e300>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-8s57cb, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-8s57cb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-8s57cb, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapErrors \| 0xc000afc960>: failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-62j2pv, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-62j2pv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-62j2pv, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapErrors \| 0xc000afc960>: failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-62j2pv, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-62j2pv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-62j2pv, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapErrors \| 0xc0010f3140>: failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-f7vgxp, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-f7vgxp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-f7vgxp, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapErrors \| 0xc0010f3140>: failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-f7vgxp, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-f7vgxp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-f7vgxp, error: context deadline exceeded ... occurred Deserializaion Error: no output from command 19:05:20 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite prod/parallel Show raw failure ime: 2h29m59.889s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:119 In [It] (Node Runtime: 2h29m59.889s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:119 At [By Step] creating the HCP cluster (Step Runtime: 8m56.845s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:151 Spec Goroutine goroutine 105 [select] github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x91df528, 0xc0008d6410}, 0x8632aa5?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x921ee80, {0x91df528, 0xc0008d6410}, 0x0) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait20240610({0x91df598?, 0xc000262230?}, {{0x91f9240?, 0xc000bdb500?}, 0xc000df0ea0?}, 0xc00008f708, {0xc0016944f8, 0x11}, {0x8653140, 0x12}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:906 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CreateHCPClusterFromParam20240610(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc001696890, 0x7}, ...}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:353 > github.com/Azure/ARO-HCP/test/e2e.init.func16.2.1({0x7f7694417860, 0xc000d14f30}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:152 \| \| By("creating the HCP cluster") > err = tc.CreateHCPClusterFromParam20240610( \| ctx, \| GinkgoLogr, github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x91f9850?, 0xc000d14f30?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 103 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159 @ 06/08/26 21:51:59.012 "ts"="2026-06-08 21:51:59.012501" "level"=0 "msg"="===== TEST CASE ENDED: FAILURE =====" "ts"="2026-06-08 21:51:59.012523" "level"=0 "msg"="===== CLEANUP BEGAN =====" "ts"="2026-06-08 21:51:59.012604" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-06-08 21:51:59.012661" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-patch-tags-cluster-xt75mv" "resourceGroup"="patch-tags-k2sn7j" "ts"="2026-06-08 21:51:59.121922" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-patch-tags-cluster-xt75mv" "resourceGroup"="" "ts"="2026-06-08 21:51:59.945884" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-4117c8518f426e648f352d29f774d8baa91734601e145475be95e6bea8053dce.yaml.gz" "ts"="2026-06-08 21:51:59.945984" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-4117c8518f426e648f352d29f774d8baa91734601e145475be95e6bea8053dce.yaml.gz" "ts"="2026-06-08 21:51:59.946058" "level"=0 "msg"="collecting debug info" "ts"="2026-06-08 21:51:59.947757" "level"=0 "msg"="collecting deployments" "resourceGroup"="patch-tags-k2sn7j" "ts"="2026-06-08 21:51:59.947774" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-146" "ts"="2026-06-08 21:52:00.263378" "level"=0 "msg"="collecting operations" "resourceGroup"="patch-tags-k2sn7j" "deployment"="pooledNonMsiScopedAssignments-fklo75htpxzxc" "ts"="2026-06-08 21:52:00.317886" "level"=0 "msg"="collecting operations" "resourceGroup"="patch-tags-k2sn7j" "deployment"="customer-infra-patch-tags-cluster-xt75mv" "ts"="2026-06-08 21:52:01.555256" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-146" "deployment"="pooledMsiScopedAssignments" "ts"="2026-06-08 21:52:01.845940" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-146" "deployment"="msi-deployment-146" "ts"="2026-06-08 21:52:01.955263" "level"=0 "msg"="finished collecting debug info" "ts"="2026-06-08 21:52:02.138048" "level"=0 "msg"="deleting created resources" "ts"="2026-06-08 21:52:02.138229" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="patch-tags-k2sn7j" Command Error: signal: killed Deserializaion Error: no output from command ime: 2h29m59.889s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:119 In [It] (Node Runtime: 2h29m59.889s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:119 At [By Step] creating the HCP cluster (Step Runtime: 8m56.845s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:151 Spec Goroutine goroutine 105 [select] github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x91df528, 0xc0008d6410}, 0x8632aa5?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x921ee80, {0x91df528, 0xc0008d6410}, 0x0) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait20240610({0x91df598?, 0xc000262230?}, {{0x91f9240?, 0xc000bdb500?}, 0xc000df0ea0?}, 0xc00008f708, {0xc0016944f8, 0x11}, {0x8653140, 0x12}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:906 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CreateHCPClusterFromParam20240610(_, {_, _}, {{_, _}, _}, {_, _}, {{0xc001696890, 0x7}, ...}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:353 > github.com/Azure/ARO-HCP/test/e2e.init.func16.2.1({0x7f7694417860, 0xc000d14f30}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:152 \| \| By("creating the HCP cluster") > err = tc.CreateHCPClusterFromParam20240610( \| ctx, \| GinkgoLogr, github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x91f9850?, 0xc000d14f30?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 103 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159 @ 06/08/26 21:51:59.012 "ts"="2026-06-08 21:51:59.012501" "level"=0 "msg"="===== TEST CASE ENDED: FAILURE =====" "ts"="2026-06-08 21:51:59.012523" "level"=0 "msg"="===== CLEANUP BEGAN =====" "ts"="2026-06-08 21:51:59.012604" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-06-08 21:51:59.012661" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-patch-tags-cluster-xt75mv" "resourceGroup"="patch-tags-k2sn7j" "ts"="2026-06-08 21:51:59.121922" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-patch-tags-cluster-xt75mv" "resourceGroup"="" "ts"="2026-06-08 21:51:59.945884" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-4117c8518f426e648f352d29f774d8baa91734601e145475be95e6bea8053dce.yaml.gz" "ts"="2026-06-08 21:51:59.945984" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-4117c8518f426e648f352d29f774d8baa91734601e145475be95e6bea8053dce.yaml.gz" "ts"="2026-06-08 21:51:59.946058" "level"=0 "msg"="collecting debug info" "ts"="2026-06-08 21:51:59.947757" "level"=0 "msg"="collecting deployments" "resourceGroup"="patch-tags-k2sn7j" "ts"="2026-06-08 21:51:59.947774" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-146" "ts"="2026-06-08 21:52:00.263378" "level"=0 "msg"="collecting operations" "resourceGroup"="patch-tags-k2sn7j" "deployment"="pooledNonMsiScopedAssignments-fklo75htpxzxc" "ts"="2026-06-08 21:52:00.317886" "level"=0 "msg"="collecting operations" "resourceGroup"="patch-tags-k2sn7j" "deployment"="customer-infra-patch-tags-cluster-xt75mv" "ts"="2026-06-08 21:52:01.555256" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-146" "deployment"="pooledMsiScopedAssignments" "ts"="2026-06-08 21:52:01.845940" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-146" "deployment"="msi-deployment-146" "ts"="2026-06-08 21:52:01.955263" "level"=0 "msg"="finished collecting debug info" "ts"="2026-06-08 21:52:02.138048" "level"=0 "msg"="deleting created resources" "ts"="2026-06-08 21:52:02.138229" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="patch-tags-k2sn7j" Command Error: signal: killed Deserializaion Error: no output from command timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-22-zd999h" with version 4.22.0-rc.3 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc0014b8090>: failed to create HCP cluster cluster-zstream-4-22-zd999h, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-zd999h in resource group rg-zstream-upgrade-4-22-57schr, error: failed waiting for cluster="cluster-zstream-4-22-zd999h" in resourcegroup="rg-zstream-upgrade-4-22-57schr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-zd999h in resource group rg-zstream-upgrade-4-22-57schr, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:137]: failed to create HCP cluster "cluster-zstream-4-22-zd999h" with version 4.22.0-rc.3 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc0014b8090>: failed to create HCP cluster cluster-zstream-4-22-zd999h, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-zd999h in resource group rg-zstream-upgrade-4-22-57schr, error: failed waiting for cluster="cluster-zstream-4-22-zd999h" in resourcegroup="rg-zstream-upgrade-4-22-57schr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-zd999h in resource group rg-zstream-upgrade-4-22-57schr, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-ddlfbc/cluster-nightly-4-23-p75r4j should provision Unexpected error: <fmt.wrapErrors \| 0xc0017b39b0>: failed waiting for cluster="cluster-nightly-4-23-p75r4j" in resourcegroup="rg-nightly-4-23-ddlfbc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-p75r4j in resource group rg-nightly-4-23-ddlfbc, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-4-23-ddlfbc/cluster-nightly-4-23-p75r4j should provision Unexpected error: <fmt.wrapErrors \| 0xc0017b39b0>: failed waiting for cluster="cluster-nightly-4-23-p75r4j" in resourcegroup="rg-nightly-4-23-ddlfbc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-4-23-p75r4j in resource group rg-nightly-4-23-ddlfbc, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test MISE Routing routes to the correct frontend based on version header default route returns no version header · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc0017c4870>: failed waiting for cluster="mise-routing" in resourcegroup="mise-default-smoke-f67h5r" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-default-smoke-f67h5r, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/mise_routing.go:132]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc0017c4870>: failed waiting for cluster="mise-routing" in resourcegroup="mise-default-smoke-f67h5r" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster mise-routing in resource group mise-default-smoke-f67h5r, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.21 minor to 4.22 minor · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:158]: failed to create HCP cluster "cp-ystream-upgrade-4-22-mp2rvz" with install version 4.21.17 Unexpected error: <fmt.wrapErrors \| 0xc000ffe240>: failed to create HCP cluster cp-ystream-upgrade-4-22-mp2rvz, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-22-mp2rvz in resource group rg-cp-ystream-upgrade-4-22-r6rqt2, error: failed waiting for cluster="cp-ystream-upgrade-4-22-mp2rvz" in resourcegroup="rg-cp-ystream-upgrade-4-22-r6rqt2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-22-mp2rvz in resource group rg-cp-ystream-upgrade-4-22-r6rqt2, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:158]: failed to create HCP cluster "cp-ystream-upgrade-4-22-mp2rvz" with install version 4.21.17 Unexpected error: <fmt.wrapErrors \| 0xc000ffe240>: failed to create HCP cluster cp-ystream-upgrade-4-22-mp2rvz, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-22-mp2rvz in resource group rg-cp-ystream-upgrade-4-22-r6rqt2, error: failed waiting for cluster="cp-ystream-upgrade-4-22-mp2rvz" in resourcegroup="rg-cp-ystream-upgrade-4-22-r6rqt2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cp-ystream-upgrade-4-22-mp2rvz in resource group rg-cp-ystream-upgrade-4-22-r6rqt2, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-21-9l2tgc/cluster-candidate-4-21-rhbss4 should provision Unexpected error: <fmt.wrapErrors \| 0xc0011c55f0>: failed to create HCP cluster cluster-candidate-4-21-rhbss4, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-rhbss4 in resource group rg-candidate-4-21-9l2tgc, error: failed waiting for cluster="cluster-candidate-4-21-rhbss4" in resourcegroup="rg-candidate-4-21-9l2tgc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-rhbss4 in resource group rg-candidate-4-21-9l2tgc, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:137]: HCP cluster rg-candidate-4-21-9l2tgc/cluster-candidate-4-21-rhbss4 should provision Unexpected error: <fmt.wrapErrors \| 0xc0011c55f0>: failed to create HCP cluster cluster-candidate-4-21-rhbss4, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-rhbss4 in resource group rg-candidate-4-21-9l2tgc, error: failed waiting for cluster="cluster-candidate-4-21-rhbss4" in resourcegroup="rg-candidate-4-21-9l2tgc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-rhbss4 in resource group rg-candidate-4-21-9l2tgc, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-h59vql with version 4.21.18 Unexpected error: <fmt.wrapErrors \| 0xc0014e71a0>: failed to create HCP cluster np-version-upgrade-cluster-h59vql, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-h59vql in resource group rg-np-version-upgrade-h59vql-w2xfqf, error: failed waiting for cluster="np-version-upgrade-cluster-h59vql" in resourcegroup="rg-np-version-upgrade-h59vql-w2xfqf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-h59vql in resource group rg-np-version-upgrade-h59vql-w2xfqf, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-h59vql with version 4.21.18 Unexpected error: <fmt.wrapErrors \| 0xc0014e71a0>: failed to create HCP cluster np-version-upgrade-cluster-h59vql, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-h59vql in resource group rg-np-version-upgrade-h59vql-w2xfqf, error: failed waiting for cluster="np-version-upgrade-cluster-h59vql" in resourcegroup="rg-np-version-upgrade-h59vql-w2xfqf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-h59vql in resource group rg-np-version-upgrade-h59vql-w2xfqf, error: context deadline exceeded ... occurred Cluster should become ready within '20.000000' minutes 19:05:20 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s. Cluster should become ready within '20.000000' minutes Expected <bool>: ... to be true fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s. Cluster should become ready within '20.000000' minutes Expected <bool>: ... to be true timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-7kbv2c/cluster-nightly-5-0-75csg9 should provision Unexpected error: <fmt.wrapErrors \| 0xc000fd68d0>: failed waiting for cluster="cluster-nightly-5-0-75csg9" in resourcegroup="rg-nightly-5-0-7kbv2c" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-75csg9 in resource group rg-nightly-5-0-7kbv2c, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:126]: Swift cluster rg-nightly-5-0-7kbv2c/cluster-nightly-5-0-75csg9 should provision Unexpected error: <fmt.wrapErrors \| 0xc000fd68d0>: failed waiting for cluster="cluster-nightly-5-0-75csg9" in resourcegroup="rg-nightly-5-0-7kbv2c" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cluster-nightly-5-0-75csg9 in resource group rg-nightly-5-0-7kbv2c, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 19:05:20 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapErrors \| 0xc0010dac30>: failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-m7dz57, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-m7dz57" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-m7dz57, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapErrors \| 0xc0010dac30>: failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-m7dz57, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-m7dz57" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-m7dz57, error: context deadline exceeded ... occurred
16:05:29	branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	1	e2e (1) timeout during CreateHCPClusterAndWait; context deadline exceeded 16:05:29 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapErrors \| 0xc0013bce10>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-hmsqhb, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-hmsqhb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-hmsqhb, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapErrors \| 0xc0013bce10>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-hmsqhb, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-hmsqhb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-hmsqhb, error: context deadline exceeded ... occurred
09:00:57	branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
02:00:02	periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	2	e2e (2) ERROR CODE: MultipleErrorsOccurred; detail code InvalidRequestContent; detail message Invalid value: "4.19.33": cannot downgrade from version 4.21.18 to 4.19.33; provider Microsoft.RedHatOpenShift 02:00:02 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to update nodepool npdg-421-419 to downgrade target 4.19.33 Unexpected error: <fmt.wrapError \| 0xc00039e480>: failed to start nodepool "npdg-421-419" update in cluster "np-dg-minor-mkwzwg" resourcegroup="rg-np-dg-minor-mkwzwg-pcf6kp": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-mkwzwg-pcf6kp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-mkwzwg/nodePools/npdg-421-419 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: MultipleErrorsOccurred -------------------------------------------------------------------------------- { "error": { "code": "MultipleErrorsOccurred", "message": "2 errors occurred", "details": [ { "code": "InvalidRequestContent", "message": "Invalid value: \"4.19.33\": invalid node pool version 4.19.33: cannot downgrade from current version 4.21.18", "target": "properties.version.id" }, { "code": "InvalidRequestContent", "message": "Invalid value: \"4.19.33\": cannot downgrade from version 4.21.18 to 4.19.33", "target": "properties.version.id" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to update nodepool npdg-421-419 to downgrade target 4.19.33 Unexpected error: <fmt.wrapError \| 0xc00039e480>: failed to start nodepool "npdg-421-419" update in cluster "np-dg-minor-mkwzwg" resourcegroup="rg-np-dg-minor-mkwzwg-pcf6kp": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-mkwzwg-pcf6kp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-mkwzwg/nodePools/npdg-421-419 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: MultipleErrorsOccurred -------------------------------------------------------------------------------- { "error": { "code": "MultipleErrorsOccurred", "message": "2 errors occurred", "details": [ { "code": "InvalidRequestContent", "message": "Invalid value: \"4.19.33\": invalid node pool version 4.19.33: cannot downgrade from current version 4.21.18", "target": "properties.version.id" }, { "code": "InvalidRequestContent", "message": "Invalid value: \"4.19.33\": cannot downgrade from version 4.21.18 to 4.19.33", "target": "properties.version.id" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: MultipleErrorsOccurred; detail code InvalidRequestContent; detail message Invalid value: "4.21.17": cannot downgrade from version 4.21.18 to 4.21.17; provider Microsoft.RedHatOpenShift 02:00:02 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:619]: failed to update nodepool npdg-4-21 to downgrade target 4.21.17 Unexpected error: <fmt.wrapError \| 0xc000134780>: failed to start nodepool "npdg-4-21" update in cluster "np-downgrade-z52pvc" resourcegroup="rg-np-downgrade-z52pvc-w5x8s7": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-z52pvc-w5x8s7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-z52pvc/nodePools/npdg-4-21 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: MultipleErrorsOccurred -------------------------------------------------------------------------------- { "error": { "code": "MultipleErrorsOccurred", "message": "2 errors occurred", "details": [ { "code": "InvalidRequestContent", "message": "Invalid value: \"4.21.17\": invalid node pool version 4.21.17: cannot downgrade from current version 4.21.18", "target": "properties.version.id" }, { "code": "InvalidRequestContent", "message": "Invalid value: \"4.21.17\": cannot downgrade from version 4.21.18 to 4.21.17", "target": "properties.version.id" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:619]: failed to update nodepool npdg-4-21 to downgrade target 4.21.17 Unexpected error: <fmt.wrapError \| 0xc000134780>: failed to start nodepool "npdg-4-21" update in cluster "np-downgrade-z52pvc" resourcegroup="rg-np-downgrade-z52pvc-w5x8s7": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-z52pvc-w5x8s7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-z52pvc/nodePools/npdg-4-21 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: MultipleErrorsOccurred -------------------------------------------------------------------------------- { "error": { "code": "MultipleErrorsOccurred", "message": "2 errors occurred", "details": [ { "code": "InvalidRequestContent", "message": "Invalid value: \"4.21.17\": invalid node pool version 4.21.17: cannot downgrade from current version 4.21.18", "target": "properties.version.id" }, { "code": "InvalidRequestContent", "message": "Invalid value: \"4.21.17\": cannot downgrade from version 4.21.18 to 4.21.17", "target": "properties.version.id" } ] } } -------------------------------------------------------------------------------- ... occurred