CIHealth Run Log

Environment: INT

Time (UTC)	Job	Failed at	Result	PR	Failed tests	Details
21:28:16	periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	21	e2e (21) timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:83]: Unexpected error: <fmt.wrapErrors \| 0xc00148e090>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-qc7ssx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: context deadline exceeded { msg: "failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: failed waiting for cluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-qc7ssx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0015fd680>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx", }, <fmt.wrapErrors \| 0xc00148e060>{ msg: "failed waiting for cluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-qc7ssx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0015fd680>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:83]: Unexpected error: <fmt.wrapErrors \| 0xc00148e090>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-qc7ssx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: context deadline exceeded { msg: "failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: failed waiting for cluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-qc7ssx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0015fd680>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx", }, <fmt.wrapErrors \| 0xc00148e060>{ msg: "failed waiting for cluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-qc7ssx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0015fd680>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-qc7ssx", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error: <fmt.wrapErrors \| 0xc00099aba0>: failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-54jcpw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: context deadline exceeded { msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-54jcpw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000a46c70>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw", }, <fmt.wrapErrors \| 0xc00099ab70>{ msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-54jcpw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000a46c70>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error: <fmt.wrapErrors \| 0xc00099aba0>: failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-54jcpw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: context deadline exceeded { msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-54jcpw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000a46c70>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw", }, <fmt.wrapErrors \| 0xc00099ab70>{ msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-54jcpw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000a46c70>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-54jcpw", }, <context.deadlineExceededError>{}, ], }, ], } occurred Deserializaion Error: no output from command 21:28:16 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite integration/parallel Show raw failure urrent progress report: Customer should respect cluster-wide node limits with nodepool autoscaling (Spec Runtime: 1h29m59.84s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122 In [It] (Node Runtime: 1h29m59.84s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122 At [By Step] creating cluster with MaxNodesTotal limit (Step Runtime: 23m49.32s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:143 Spec Goroutine goroutine 44 [select] github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000734550}, 0x77f8912?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000734550}, 0x0) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284 github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc00036f340?}, {{0x8229828?, 0xc00082a180?}, 0xc000af0970?}, 0xc000095810, {0xc00138a2d0, 0x16}, {0x7814759, 0x12}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344 > github.com/Azure/ARO-HCP/test/e2e.init.func22.3({0x7fd3a6726b10, 0xc0009509f0}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:160 \| Expect(err).NotTo(HaveOccurred()) \| > err = tc.CreateHCPClusterFromParam(ctx, \| GinkgoLogr, \| resourceGroup.Name, github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc0009509f0?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 107 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166 @ 03/07/26 23:09:29.214 "ts"="2026-03-07 23:09:29.214402" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-03-07 23:09:29.214455" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-node-limit-cluster-564z9f" "resourceGroup"="node-limit-test-jsd8j7" "ts"="2026-03-07 23:09:29.539378" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-node-limit-cluster-564z9f" "resourceGroup"="" "ts"="2026-03-07 23:09:30.645108" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz" "ts"="2026-03-07 23:09:30.645242" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz" "ts"="2026-03-07 23:09:30.645309" "level"=0 "msg"="collecting debug info" "ts"="2026-03-07 23:09:30.646318" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-67" "ts"="2026-03-07 23:09:30.646334" "level"=0 "msg"="collecting deployments" "resourceGroup"="node-limit-test-jsd8j7" "ts"="2026-03-07 23:09:30.808861" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-67" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:30.828467" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-jsd8j7" "deployment"="pooledNonMsiScopedAssignments-j6nw3ohx7bzo4" "ts"="2026-03-07 23:09:30.959675" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-jsd8j7" "deployment"="customer-infra-node-limit-cluster-564z9f" "ts"="2026-03-07 23:09:31.116478" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-67" "deployment"="msi-deployment-67" "ts"="2026-03-07 23:09:31.255318" "level"=0 "msg"="finished collecting debug info" "ts"="2026-03-07 23:09:31.255416" "level"=0 "msg"="deleting created resources" "ts"="2026-03-07 23:09:31.255513" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="node-limit-test-jsd8j7" Command Error: signal: killed Deserializaion Error: no output from command urrent progress report: Customer should respect cluster-wide node limits with nodepool autoscaling (Spec Runtime: 1h29m59.84s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122 In [It] (Node Runtime: 1h29m59.84s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122 At [By Step] creating cluster with MaxNodesTotal limit (Step Runtime: 23m49.32s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:143 Spec Goroutine goroutine 44 [select] github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000734550}, 0x77f8912?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000734550}, 0x0) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284 github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc00036f340?}, {{0x8229828?, 0xc00082a180?}, 0xc000af0970?}, 0xc000095810, {0xc00138a2d0, 0x16}, {0x7814759, 0x12}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344 > github.com/Azure/ARO-HCP/test/e2e.init.func22.3({0x7fd3a6726b10, 0xc0009509f0}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:160 \| Expect(err).NotTo(HaveOccurred()) \| > err = tc.CreateHCPClusterFromParam(ctx, \| GinkgoLogr, \| resourceGroup.Name, github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc0009509f0?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 107 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166 @ 03/07/26 23:09:29.214 "ts"="2026-03-07 23:09:29.214402" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-03-07 23:09:29.214455" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-node-limit-cluster-564z9f" "resourceGroup"="node-limit-test-jsd8j7" "ts"="2026-03-07 23:09:29.539378" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-node-limit-cluster-564z9f" "resourceGroup"="" "ts"="2026-03-07 23:09:30.645108" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz" "ts"="2026-03-07 23:09:30.645242" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz" "ts"="2026-03-07 23:09:30.645309" "level"=0 "msg"="collecting debug info" "ts"="2026-03-07 23:09:30.646318" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-67" "ts"="2026-03-07 23:09:30.646334" "level"=0 "msg"="collecting deployments" "resourceGroup"="node-limit-test-jsd8j7" "ts"="2026-03-07 23:09:30.808861" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-67" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:30.828467" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-jsd8j7" "deployment"="pooledNonMsiScopedAssignments-j6nw3ohx7bzo4" "ts"="2026-03-07 23:09:30.959675" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-jsd8j7" "deployment"="customer-infra-node-limit-cluster-564z9f" "ts"="2026-03-07 23:09:31.116478" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-67" "deployment"="msi-deployment-67" "ts"="2026-03-07 23:09:31.255318" "level"=0 "msg"="finished collecting debug info" "ts"="2026-03-07 23:09:31.255416" "level"=0 "msg"="deleting created resources" "ts"="2026-03-07 23:09:31.255513" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="node-limit-test-jsd8j7" Command Error: signal: killed Deserializaion Error: no output from command timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error: <fmt.wrapErrors \| 0xc000fd82a0>: failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-np8h5m" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: context deadline exceeded { msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-np8h5m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ea7a00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m", }, <fmt.wrapErrors \| 0xc000fd8270>{ msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-np8h5m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ea7a00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error: <fmt.wrapErrors \| 0xc000fd82a0>: failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-np8h5m" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: context deadline exceeded { msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-np8h5m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ea7a00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m", }, <fmt.wrapErrors \| 0xc000fd8270>{ msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-np8h5m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ea7a00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-np8h5m", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error: <fmt.wrapErrors \| 0xc001514090>: failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t9wxf2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: context deadline exceeded { msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9wxf2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000d52890>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2", }, <fmt.wrapErrors \| 0xc001514060>{ msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9wxf2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000d52890>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error: <fmt.wrapErrors \| 0xc001514090>: failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t9wxf2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: context deadline exceeded { msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9wxf2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000d52890>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2", }, <fmt.wrapErrors \| 0xc001514060>{ msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9wxf2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000d52890>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9wxf2", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error: <fmt.wrapErrors \| 0xc00114ab40>: failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-7hzpkh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: context deadline exceeded { msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-7hzpkh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000b39de0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh", }, <fmt.wrapErrors \| 0xc00114ab10>{ msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-7hzpkh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000b39de0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error: <fmt.wrapErrors \| 0xc00114ab40>: failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-7hzpkh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: context deadline exceeded { msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-7hzpkh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000b39de0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh", }, <fmt.wrapErrors \| 0xc00114ab10>{ msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-7hzpkh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000b39de0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-7hzpkh", }, <context.deadlineExceededError>{}, ], }, ], } occurred Deserializaion Error: no output from command 21:28:16 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite integration/parallel Show raw failure .go:284 > github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7fb680243860, 0xc0007a8ba0}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126 \| \| By("waiting for first cluster to complete creation") > _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{ \| Frequency: framework.StandardPollInterval, \| }) github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc0007a8ba0?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 104 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/07/26 23:09:29.212 "ts"="2026-03-07 23:09:29.212333" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-03-07 23:09:29.212391" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-b8lhcv" "resourceGroup"="customer-rg-rdfw7z" "ts"="2026-03-07 23:09:29.368867" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-b8lhcv" "resourceGroup"="" "ts"="2026-03-07 23:09:30.401204" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-w6dnnl" "resourceGroup"="customer-rg-rdfw7z" "ts"="2026-03-07 23:09:30.553065" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-w6dnnl" "resourceGroup"="" "ts"="2026-03-07 23:09:31.704626" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz" "ts"="2026-03-07 23:09:31.704730" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz" "ts"="2026-03-07 23:09:31.704790" "level"=0 "msg"="collecting debug info" "ts"="2026-03-07 23:09:31.705908" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-98" "ts"="2026-03-07 23:09:31.705919" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-14" "ts"="2026-03-07 23:09:31.705964" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-147" "ts"="2026-03-07 23:09:31.705944" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-rdfw7z" "ts"="2026-03-07 23:09:31.851105" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-147" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.862895" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-14" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.897487" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32" "ts"="2026-03-07 23:09:31.930676" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-98" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.979247" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-147" "deployment"="msi-deployment-147" "ts"="2026-03-07 23:09:31.991987" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-14" "deployment"="msi-deployment-14" "ts"="2026-03-07 23:09:32.065912" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-98" "deployment"="msi-deployment-98" "ts"="2026-03-07 23:09:32.075509" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="customer-infra-basic-hcp-cluster2-w6dnnl" "ts"="2026-03-07 23:09:32.444727" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4" "ts"="2026-03-07 23:09:32.605189" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="customer-infra-basic-hcp-cluster-b8lhcv" "ts"="2026-03-07 23:09:32.764560" "level"=0 "msg"="finished collecting debug info" "ts"="2026-03-07 23:09:32.764662" "level"=0 "msg"="deleting created resources" "ts"="2026-03-07 23:09:32.764749" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-rdfw7z" Command Error: signal: killed Deserializaion Error: no output from command .go:284 > github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7fb680243860, 0xc0007a8ba0}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126 \| \| By("waiting for first cluster to complete creation") > _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{ \| Frequency: framework.StandardPollInterval, \| }) github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc0007a8ba0?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 104 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/07/26 23:09:29.212 "ts"="2026-03-07 23:09:29.212333" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-03-07 23:09:29.212391" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-b8lhcv" "resourceGroup"="customer-rg-rdfw7z" "ts"="2026-03-07 23:09:29.368867" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-b8lhcv" "resourceGroup"="" "ts"="2026-03-07 23:09:30.401204" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-w6dnnl" "resourceGroup"="customer-rg-rdfw7z" "ts"="2026-03-07 23:09:30.553065" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-w6dnnl" "resourceGroup"="" "ts"="2026-03-07 23:09:31.704626" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz" "ts"="2026-03-07 23:09:31.704730" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz" "ts"="2026-03-07 23:09:31.704790" "level"=0 "msg"="collecting debug info" "ts"="2026-03-07 23:09:31.705908" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-98" "ts"="2026-03-07 23:09:31.705919" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-14" "ts"="2026-03-07 23:09:31.705964" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-147" "ts"="2026-03-07 23:09:31.705944" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-rdfw7z" "ts"="2026-03-07 23:09:31.851105" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-147" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.862895" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-14" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.897487" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32" "ts"="2026-03-07 23:09:31.930676" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-98" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.979247" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-147" "deployment"="msi-deployment-147" "ts"="2026-03-07 23:09:31.991987" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-14" "deployment"="msi-deployment-14" "ts"="2026-03-07 23:09:32.065912" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-98" "deployment"="msi-deployment-98" "ts"="2026-03-07 23:09:32.075509" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="customer-infra-basic-hcp-cluster2-w6dnnl" "ts"="2026-03-07 23:09:32.444727" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4" "ts"="2026-03-07 23:09:32.605189" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-rdfw7z" "deployment"="customer-infra-basic-hcp-cluster-b8lhcv" "ts"="2026-03-07 23:09:32.764560" "level"=0 "msg"="finished collecting debug info" "ts"="2026-03-07 23:09:32.764662" "level"=0 "msg"="deleting created resources" "ts"="2026-03-07 23:09:32.764749" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-rdfw7z" Command Error: signal: killed Deserializaion Error: no output from command failed waiting for deployment "aro-hcp-demo" in resourcegroup="<resource-group>" to finish: context deadline exceeded 21:28:16 UTC · failed at e2e · test HCP Nodepools GPU instances creates and deletes vm type NC4asT4v3 in a single cluster · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error: <fmt.wrapError \| 0xc0004ac420>: failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-z4g56q" to finish: context deadline exceeded { msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-z4g56q\" to finish: context deadline exceeded", err: <context.deadlineExceededError>{}, } occurred fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error: <fmt.wrapError \| 0xc0004ac420>: failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-z4g56q" to finish: context deadline exceeded { msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-z4g56q\" to finish: context deadline exceeded", err: <context.deadlineExceededError>{}, } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error: <fmt.wrapErrors \| 0xc0010f28d0>: failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8hgjpp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: context deadline exceeded { msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8hgjpp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0011c73a0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp", }, <fmt.wrapErrors \| 0xc0010f28a0>{ msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8hgjpp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0011c73a0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error: <fmt.wrapErrors \| 0xc0010f28d0>: failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8hgjpp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: context deadline exceeded { msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8hgjpp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0011c73a0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp", }, <fmt.wrapErrors \| 0xc0010f28a0>{ msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8hgjpp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0011c73a0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-8hgjpp", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error: <fmt.wrapErrors \| 0xc0008806c0>: failed to create HCP cluster ea-listwjcw8c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: failed waiting for cluster="ea-listwjcw8c" in resourcegroup="ea-list-cnhn6n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: context deadline exceeded { msg: "failed to create HCP cluster ea-listwjcw8c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: failed waiting for cluster=\"ea-listwjcw8c\" in resourcegroup=\"ea-list-cnhn6n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001290e00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n", }, <fmt.wrapErrors \| 0xc000880690>{ msg: "failed waiting for cluster=\"ea-listwjcw8c\" in resourcegroup=\"ea-list-cnhn6n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001290e00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error: <fmt.wrapErrors \| 0xc0008806c0>: failed to create HCP cluster ea-listwjcw8c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: failed waiting for cluster="ea-listwjcw8c" in resourcegroup="ea-list-cnhn6n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: context deadline exceeded { msg: "failed to create HCP cluster ea-listwjcw8c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: failed waiting for cluster=\"ea-listwjcw8c\" in resourcegroup=\"ea-list-cnhn6n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001290e00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n", }, <fmt.wrapErrors \| 0xc000880690>{ msg: "failed waiting for cluster=\"ea-listwjcw8c\" in resourcegroup=\"ea-list-cnhn6n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001290e00>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listwjcw8c in resource group ea-list-cnhn6n", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error: <fmt.wrapErrors \| 0xc00154ee10>: failed to create HCP cluster patch-name-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-wstmzs" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: context deadline exceeded { msg: "failed to create HCP cluster patch-name-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-wstmzs\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001478e50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs", }, <fmt.wrapErrors \| 0xc00154ede0>{ msg: "failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-wstmzs\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001478e50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error: <fmt.wrapErrors \| 0xc00154ee10>: failed to create HCP cluster patch-name-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-wstmzs" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: context deadline exceeded { msg: "failed to create HCP cluster patch-name-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-wstmzs\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001478e50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs", }, <fmt.wrapErrors \| 0xc00154ede0>{ msg: "failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-wstmzs\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001478e50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-wstmzs", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error: <fmt.wrapErrors \| 0xc001210810>: failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-c6kf7m" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: context deadline exceeded { msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-c6kf7m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ffbbe0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m", }, <fmt.wrapErrors \| 0xc0012107e0>{ msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-c6kf7m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ffbbe0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error: <fmt.wrapErrors \| 0xc001210810>: failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-c6kf7m" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: context deadline exceeded { msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-c6kf7m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ffbbe0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m", }, <fmt.wrapErrors \| 0xc0012107e0>{ msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-c6kf7m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000ffbbe0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c6kf7m", }, <context.deadlineExceededError>{}, ], }, ], } occurred Cluster should become ready within 45 minutes 21:28:16 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s. Cluster should become ready within 45 minutes Expected <bool>: false to be true fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s. Cluster should become ready within 45 minutes Expected <bool>: false to be true timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error: <fmt.wrapErrors \| 0xc0014620c0>: failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-4wwwww" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: context deadline exceeded { msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-4wwwww\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0014eb8d0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww", }, <fmt.wrapErrors \| 0xc001462060>{ msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-4wwwww\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0014eb8d0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error: <fmt.wrapErrors \| 0xc0014620c0>: failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-4wwwww" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: context deadline exceeded { msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-4wwwww\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0014eb8d0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww", }, <fmt.wrapErrors \| 0xc001462060>{ msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-4wwwww\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0014eb8d0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-4wwwww", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error: <fmt.wrapErrors \| 0xc00116ccf0>: failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-hrmh9p" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-hrmh9p, error: context deadline exceeded { msg: "failed waiting for cluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-hrmh9p\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-hrmh9p, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000f6a520>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-hrmh9p", }, <context.deadlineExceededError>{}, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error: <fmt.wrapErrors \| 0xc00116ccf0>: failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-hrmh9p" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-hrmh9p, error: context deadline exceeded { msg: "failed waiting for cluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-hrmh9p\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-hrmh9p, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000f6a520>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-hrmh9p", }, <context.deadlineExceededError>{}, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error: <fmt.wrapErrors \| 0xc001420ab0>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-bjxm7n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: context deadline exceeded { msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-bjxm7n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001205080>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n", }, <fmt.wrapErrors \| 0xc001420a80>{ msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-bjxm7n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001205080>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error: <fmt.wrapErrors \| 0xc001420ab0>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-bjxm7n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: context deadline exceeded { msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-bjxm7n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001205080>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n", }, <fmt.wrapErrors \| 0xc001420a80>{ msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-bjxm7n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001205080>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-bjxm7n", }, <context.deadlineExceededError>{}, ], }, ], } occurred Deserializaion Error: no output from command 21:28:16 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite integration/parallel Show raw failure p all remaining specs. Interrupt again to skip cleanup. Here's a current progress report: Customer should be able to create node pools with ARM64-based VMs (Spec Runtime: 1h29m59.838s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35 In [It] (Node Runtime: 1h29m59.838s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35 At [By Step] creating the HCP cluster (Step Runtime: 22m55.63s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:82 Spec Goroutine goroutine 105 [select] github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000a9e320}, 0x77f8912?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000a9e320}, 0x0) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284 github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0006a04d0?}, {{0x8229828?, 0xc000755400?}, 0xc0008a8ae0?}, 0xc0000957e8, {0xc001440378, 0x17}, {0x781ed63, 0x14}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344 > github.com/Azure/ARO-HCP/test/e2e.init.func4.2({0x7fcb20176e60, 0xc000c88780}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:83 \| \| By("creating the HCP cluster") > err = tc.CreateHCPClusterFromParam( \| ctx, \| GinkgoLogr, github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000c88780?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 102 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90 @ 03/07/26 23:09:29.205 "ts"="2026-03-07 23:09:29.206087" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-03-07 23:09:29.206188" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-arm64-vm-hcp-cluster-qqhxlg" "resourceGroup"="arm64-vm-cluster-b4f8bt" "ts"="2026-03-07 23:09:29.413482" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-arm64-vm-hcp-cluster-qqhxlg" "resourceGroup"="" "ts"="2026-03-07 23:09:31.163451" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz" "ts"="2026-03-07 23:09:31.163568" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz" "ts"="2026-03-07 23:09:31.163634" "level"=0 "msg"="collecting debug info" "ts"="2026-03-07 23:09:31.164640" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-10" "ts"="2026-03-07 23:09:31.164656" "level"=0 "msg"="collecting deployments" "resourceGroup"="arm64-vm-cluster-b4f8bt" "ts"="2026-03-07 23:09:31.407942" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-10" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.474217" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-b4f8bt" "deployment"="pooledNonMsiScopedAssignments-6htyoibevj7ye" "ts"="2026-03-07 23:09:31.546551" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-10" "deployment"="msi-deployment-10" "ts"="2026-03-07 23:09:31.617334" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-b4f8bt" "deployment"="customer-infra-arm64-vm-hcp-cluster-qqhxlg" "ts"="2026-03-07 23:09:31.781469" "level"=0 "msg"="finished collecting debug info" "ts"="2026-03-07 23:09:31.781570" "level"=0 "msg"="deleting created resources" "ts"="2026-03-07 23:09:31.781667" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="arm64-vm-cluster-b4f8bt" Command Error: signal: killed Deserializaion Error: no output from command p all remaining specs. Interrupt again to skip cleanup. Here's a current progress report: Customer should be able to create node pools with ARM64-based VMs (Spec Runtime: 1h29m59.838s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35 In [It] (Node Runtime: 1h29m59.838s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35 At [By Step] creating the HCP cluster (Step Runtime: 22m55.63s) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:82 Spec Goroutine goroutine 105 [select] github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000a9e320}, 0x77f8912?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000a9e320}, 0x0) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284 github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0006a04d0?}, {{0x8229828?, 0xc000755400?}, 0xc0008a8ae0?}, 0xc0000957e8, {0xc001440378, 0x17}, {0x781ed63, 0x14}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344 > github.com/Azure/ARO-HCP/test/e2e.init.func4.2({0x7fcb20176e60, 0xc000c88780}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:83 \| \| By("creating the HCP cluster") > err = tc.CreateHCPClusterFromParam( \| ctx, \| GinkgoLogr, github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000c88780?}) /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 github.com/onsi/ginkgo/v2/internal.(Suite).runNode.func3() /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 github.com/onsi/ginkgo/v2/internal.(Suite).runNode in goroutine 102 /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 ------------------------------ [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90 @ 03/07/26 23:09:29.205 "ts"="2026-03-07 23:09:29.206087" "level"=0 "msg"="Commiting timing metadata." "ts"="2026-03-07 23:09:29.206188" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-arm64-vm-hcp-cluster-qqhxlg" "resourceGroup"="arm64-vm-cluster-b4f8bt" "ts"="2026-03-07 23:09:29.413482" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-arm64-vm-hcp-cluster-qqhxlg" "resourceGroup"="" "ts"="2026-03-07 23:09:31.163451" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz" "ts"="2026-03-07 23:09:31.163568" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-a6eb9d68aa9cc22f7e78141cf691002056d2ca6a7d34a8fba7d067b26fef9e86.yaml.gz" "ts"="2026-03-07 23:09:31.163634" "level"=0 "msg"="collecting debug info" "ts"="2026-03-07 23:09:31.164640" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-10" "ts"="2026-03-07 23:09:31.164656" "level"=0 "msg"="collecting deployments" "resourceGroup"="arm64-vm-cluster-b4f8bt" "ts"="2026-03-07 23:09:31.407942" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-10" "deployment"="pooledMsiScopedAssignments" "ts"="2026-03-07 23:09:31.474217" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-b4f8bt" "deployment"="pooledNonMsiScopedAssignments-6htyoibevj7ye" "ts"="2026-03-07 23:09:31.546551" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-10" "deployment"="msi-deployment-10" "ts"="2026-03-07 23:09:31.617334" "level"=0 "msg"="collecting operations" "resourceGroup"="arm64-vm-cluster-b4f8bt" "deployment"="customer-infra-arm64-vm-hcp-cluster-qqhxlg" "ts"="2026-03-07 23:09:31.781469" "level"=0 "msg"="finished collecting debug info" "ts"="2026-03-07 23:09:31.781570" "level"=0 "msg"="deleting created resources" "ts"="2026-03-07 23:09:31.781667" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="arm64-vm-cluster-b4f8bt" Command Error: signal: killed Deserializaion Error: no output from command timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to list HCP clusters without node pools at both subscription and resource group levels · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error: <fmt.wrapErrors \| 0xc0014ec750>: failed to create HCP cluster list-test-cluster-4gnqvn, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: failed waiting for cluster="list-test-cluster-4gnqvn" in resourcegroup="cluster-listing-csjl6b" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: context deadline exceeded { msg: "failed to create HCP cluster list-test-cluster-4gnqvn, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: failed waiting for cluster=\"list-test-cluster-4gnqvn\" in resourcegroup=\"cluster-listing-csjl6b\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0008a8cd0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b", }, <fmt.wrapErrors \| 0xc0014ec720>{ msg: "failed waiting for cluster=\"list-test-cluster-4gnqvn\" in resourcegroup=\"cluster-listing-csjl6b\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0008a8cd0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error: <fmt.wrapErrors \| 0xc0014ec750>: failed to create HCP cluster list-test-cluster-4gnqvn, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: failed waiting for cluster="list-test-cluster-4gnqvn" in resourcegroup="cluster-listing-csjl6b" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: context deadline exceeded { msg: "failed to create HCP cluster list-test-cluster-4gnqvn, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: failed waiting for cluster=\"list-test-cluster-4gnqvn\" in resourcegroup=\"cluster-listing-csjl6b\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0008a8cd0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b", }, <fmt.wrapErrors \| 0xc0014ec720>{ msg: "failed waiting for cluster=\"list-test-cluster-4gnqvn\" in resourcegroup=\"cluster-listing-csjl6b\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc0008a8cd0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-4gnqvn in resource group cluster-listing-csjl6b", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error: <fmt.wrapErrors \| 0xc000475b30>: failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-dqffm6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: context deadline exceeded { msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-dqffm6\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001029ed0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6", }, <fmt.wrapErrors \| 0xc000475b00>{ msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-dqffm6\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001029ed0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error: <fmt.wrapErrors \| 0xc000475b30>: failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-dqffm6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: context deadline exceeded { msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-dqffm6\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001029ed0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6", }, <fmt.wrapErrors \| 0xc000475b00>{ msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-dqffm6\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc001029ed0>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-dqffm6", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error: <fmt.wrapErrors \| 0xc000b2df20>: failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-h6h8pw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: context deadline exceeded { msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-h6h8pw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc00107ce50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw", }, <fmt.wrapErrors \| 0xc000b2def0>{ msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-h6h8pw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc00107ce50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error: <fmt.wrapErrors \| 0xc000b2df20>: failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-h6h8pw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: context deadline exceeded { msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-h6h8pw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc00107ce50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw", }, <fmt.wrapErrors \| 0xc000b2def0>{ msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-h6h8pw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc00107ce50>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-h6h8pw", }, <context.deadlineExceededError>{}, ], }, ], } occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 21:28:16 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error: <fmt.wrapErrors \| 0xc001225aa0>: failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-6xh9fb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: context deadline exceeded { msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-6xh9fb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000eeda60>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb", }, <fmt.wrapErrors \| 0xc001225a70>{ msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-6xh9fb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000eeda60>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb", }, <context.deadlineExceededError>{}, ], }, ], } occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error: <fmt.wrapErrors \| 0xc001225aa0>: failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-6xh9fb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: context deadline exceeded { msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-6xh9fb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000eeda60>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb", }, <fmt.wrapErrors \| 0xc001225a70>{ msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-6xh9fb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb, error: context deadline exceeded", errs: [ <errors.errorString \| 0xc000eeda60>{ s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-6xh9fb", }, <context.deadlineExceededError>{}, ], }, ], } occurred
18:40:25	periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
07:18:52	periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
05:21:29	periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
03:12:04	periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
00:12:37	periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	1	e2e (1) ERROR CODE: Conflict; detail message Cannot update resource while resource is "accepted"; provider Microsoft.RedHatOpenShift 00:12:37 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite integration/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error: <fmt.wrapError \| 0xc0009c8220>: failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="basic-cluster-lpnmcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 409: 409 Conflict ERROR CODE: Conflict -------------------------------------------------------------------------------- { "error": { "code": "Conflict", "message": "Cannot update resource while resource is \"accepted\"", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster" } } -------------------------------------------------------------------------------- { msg: "failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc0009c8200>{ msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc00125e7e0>{ ErrorCode: "Conflict", StatusCode: 409, RawResponse: { Status: "409 Conflict", StatusCode: 409, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Cache": ["CONFIG_NOCACHE"], "Date": [ "Sat, 07 Mar 2026 00:17:12 GMT", ], "Content-Type": ["application/json"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260307T001712Z:97607234-1d4e-40a3-b8e5-4aac73aa1e83", ], "X-Msedge-Ref": [ "Ref A: 8E3A3DDB29E7437B8A99525E6E2E994C Ref B: CH1AA2020603053 Ref C: 2026-03-07T00:17:12Z", ], "Cache-Control": ["no-cache"], "Content-Length": ["311"], "X-Ms-Request-Id": [ "e1ecbf3e-3dc4-4bd6-b628-f10b7dfdb837", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a8f427fa-8c59-4633-83d9-4928d11132df", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Pragma": ["no-cache"], "Expires": ["-1"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Correlation-Request-Id": [ "97607234-1d4e-40a3-b8e5-... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error: <fmt.wrapError \| 0xc0009c8220>: failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="basic-cluster-lpnmcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 409: 409 Conflict ERROR CODE: Conflict -------------------------------------------------------------------------------- { "error": { "code": "Conflict", "message": "Cannot update resource while resource is \"accepted\"", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster" } } -------------------------------------------------------------------------------- { msg: "failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc0009c8200>{ msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc00125e7e0>{ ErrorCode: "Conflict", StatusCode: 409, RawResponse: { Status: "409 Conflict", StatusCode: 409, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Cache": ["CONFIG_NOCACHE"], "Date": [ "Sat, 07 Mar 2026 00:17:12 GMT", ], "Content-Type": ["application/json"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260307T001712Z:97607234-1d4e-40a3-b8e5-4aac73aa1e83", ], "X-Msedge-Ref": [ "Ref A: 8E3A3DDB29E7437B8A99525E6E2E994C Ref B: CH1AA2020603053 Ref C: 2026-03-07T00:17:12Z", ], "Cache-Control": ["no-cache"], "Content-Length": ["311"], "X-Ms-Request-Id": [ "e1ecbf3e-3dc4-4bd6-b628-f10b7dfdb837", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a8f427fa-8c59-4633-83d9-4928d11132df", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Pragma": ["no-cache"], "Expires": ["-1"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Correlation-Request-Id": [ "97607234-1d4e-40a3-b8e5-... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred