No failure patterns match your search.
Environment: PROD
Failure patterns: 22 · Failures matched: 80 · Total runs: 39 · Runs affected: 19
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: NoiseSignal: Noise — source deserialization/no-output error | e2e | 2 | 5.13%2 of 39 job runs affected | NoiseSignal: Noise — source deserialization/no-output error | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 1 · Mar 19: 1 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)284
> github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7fe3c01a6a60, 0xc00085a750})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x827b940?, 0xc00085a750?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 99
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/19/26 04:21:45.455
"ts"="2026-03-19 04:21:45.455935" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-19 04:21:45.456006" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-qpcr94" "resourceGroup"="customer-rg-ggrxmh"
"ts"="2026-03-19 04:21:45.775140" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-qpcr94" "resourceGroup"=""
"ts"="2026-03-19 04:21:48.084018" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-lzd56b" "resourceGroup"="customer-rg-ggrxmh"
"ts"="2026-03-19 04:21:48.957488" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-lzd56b" "resourceGroup"=""
"ts"="2026-03-19 04:21:51.648746" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-19 04:21:51.648859" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-19 04:21:51.648920" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-19 04:21:51.650029" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-9"
"ts"="2026-03-19 04:21:51.650042" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-56"
"ts"="2026-03-19 04:21:51.650081" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-149"
"ts"="2026-03-19 04:21:51.650073" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-ggrxmh"
"ts"="2026-03-19 04:21:51.830715" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-56" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-19 04:21:51.980503" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-56" "deployment"="msi-deployment-56"
"ts"="2026-03-19 04:21:51.996787" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-19 04:21:52.175678" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-9" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-19 04:21:52.295989" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="customer-infra-basic-hcp-cluster2-lzd56b"
"ts"="2026-03-19 04:21:52.334633" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-9" "deployment"="msi-deployment-9"
"ts"="2026-03-19 04:21:52.554390" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-149" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-19 04:21:52.597003" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-19 04:21:52.680006" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-149" "deployment"="msi-deployment-149"
"ts"="2026-03-19 04:21:52.958897" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="customer-infra-basic-hcp-cluster-qpcr94"
"ts"="2026-03-19 04:21:53.267438" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-19 04:21:53.267585" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-19 04:21:53.267718" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-ggrxmh"
Command Error: signal: killed
Deserializaion Error: no output from command
284
> github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7fe3c01a6a60, 0xc00085a750})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x827b940?, 0xc00085a750?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 99
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/19/26 04:21:45.455
"ts"="2026-03-19 04:21:45.455935" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-19 04:21:45.456006" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-qpcr94" "resourceGroup"="customer-rg-ggrxmh"
"ts"="2026-03-19 04:21:45.775140" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-qpcr94" "resourceGroup"=""
"ts"="2026-03-19 04:21:48.084018" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-lzd56b" "resourceGroup"="customer-rg-ggrxmh"
"ts"="2026-03-19 04:21:48.957488" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-lzd56b" "resourceGroup"=""
"ts"="2026-03-19 04:21:51.648746" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-19 04:21:51.648859" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-19 04:21:51.648920" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-19 04:21:51.650029" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-9"
"ts"="2026-03-19 04:21:51.650042" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-56"
"ts"="2026-03-19 04:21:51.650081" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-149"
"ts"="2026-03-19 04:21:51.650073" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-ggrxmh"
"ts"="2026-03-19 04:21:51.830715" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-56" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-19 04:21:51.980503" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-56" "deployment"="msi-deployment-56"
"ts"="2026-03-19 04:21:51.996787" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-19 04:21:52.175678" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-9" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-19 04:21:52.295989" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="customer-infra-basic-hcp-cluster2-lzd56b"
"ts"="2026-03-19 04:21:52.334633" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-9" "deployment"="msi-deployment-9"
"ts"="2026-03-19 04:21:52.554390" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-149" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-19 04:21:52.597003" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-19 04:21:52.680006" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-149" "deployment"="msi-deployment-149"
"ts"="2026-03-19 04:21:52.958897" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-ggrxmh" "deployment"="customer-infra-basic-hcp-cluster-qpcr94"
"ts"="2026-03-19 04:21:53.267438" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-19 04:21:53.267585" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-19 04:21:53.267718" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-ggrxmh"
Command Error: signal: killed
Deserializaion Error: no output from command> github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7f54ec580e60, 0xc0009fb7d0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x827b940?, 0xc0009fb7d0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 84
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/18/26 23:20:55.083
"ts"="2026-03-18 23:20:55.083532" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-18 23:20:55.083598" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-kjjpjb" "resourceGroup"="customer-rg-2hmq5s"
"ts"="2026-03-18 23:20:55.333961" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-kjjpjb" "resourceGroup"=""
"ts"="2026-03-18 23:20:56.369508" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-wlxsb8" "resourceGroup"="customer-rg-2hmq5s"
"ts"="2026-03-18 23:20:56.519635" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-wlxsb8" "resourceGroup"=""
"ts"="2026-03-18 23:20:57.115820" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-18 23:20:57.115955" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-18 23:20:57.116022" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-18 23:20:57.117126" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-26"
"ts"="2026-03-18 23:20:57.117146" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-110"
"ts"="2026-03-18 23:20:57.117168" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-2hmq5s"
"ts"="2026-03-18 23:20:57.117208" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-36"
"ts"="2026-03-18 23:20:57.264846" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-110" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-18 23:20:57.327570" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-36" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-18 23:20:57.396893" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-110" "deployment"="msi-deployment-110"
"ts"="2026-03-18 23:20:57.432057" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-18 23:20:57.548409" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-36" "deployment"="msi-deployment-36"
"ts"="2026-03-18 23:20:57.629848" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="customer-infra-basic-hcp-cluster2-wlxsb8"
"ts"="2026-03-18 23:20:57.773291" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-26" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-18 23:20:57.819000" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-18 23:20:57.904929" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="customer-infra-basic-hcp-cluster-kjjpjb"
"ts"="2026-03-18 23:20:58.268158" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-26" "deployment"="msi-deployment-26"
"ts"="2026-03-18 23:20:58.435912" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-18 23:20:58.436063" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-18 23:20:58.436192" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-2hmq5s"
Command Error: signal: killed
Deserializaion Error: no output from command
> github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7f54ec580e60, 0xc0009fb7d0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x827b940?, 0xc0009fb7d0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 84
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/18/26 23:20:55.083
"ts"="2026-03-18 23:20:55.083532" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-18 23:20:55.083598" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-kjjpjb" "resourceGroup"="customer-rg-2hmq5s"
"ts"="2026-03-18 23:20:55.333961" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-kjjpjb" "resourceGroup"=""
"ts"="2026-03-18 23:20:56.369508" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-wlxsb8" "resourceGroup"="customer-rg-2hmq5s"
"ts"="2026-03-18 23:20:56.519635" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-wlxsb8" "resourceGroup"=""
"ts"="2026-03-18 23:20:57.115820" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-18 23:20:57.115955" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-18 23:20:57.116022" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-18 23:20:57.117126" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-26"
"ts"="2026-03-18 23:20:57.117146" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-110"
"ts"="2026-03-18 23:20:57.117168" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-2hmq5s"
"ts"="2026-03-18 23:20:57.117208" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-36"
"ts"="2026-03-18 23:20:57.264846" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-110" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-18 23:20:57.327570" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-36" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-18 23:20:57.396893" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-110" "deployment"="msi-deployment-110"
"ts"="2026-03-18 23:20:57.432057" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-18 23:20:57.548409" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-36" "deployment"="msi-deployment-36"
"ts"="2026-03-18 23:20:57.629848" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="customer-infra-basic-hcp-cluster2-wlxsb8"
"ts"="2026-03-18 23:20:57.773291" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-26" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-18 23:20:57.819000" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-18 23:20:57.904929" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-2hmq5s" "deployment"="customer-infra-basic-hcp-cluster-kjjpjb"
"ts"="2026-03-18 23:20:58.268158" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-26" "deployment"="msi-deployment-26"
"ts"="2026-03-18 23:20:58.435912" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-18 23:20:58.436063" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-18 23:20:58.436192" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-2hmq5s"
Command Error: signal: killed
Deserializaion Error: no output from commandContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
or adjust the parameters in Gomega's 'format' package.full failure pattern: or adjust the parameters in Gomega's 'format' package. Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 6 | 15.38%6 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 6 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc0014e61e0>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE: ProviderError
--------------------------------------------------------------------------------
{
"error": {
"code": "ProviderError",
"message": "Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "ProviderError",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T155939Z:81a9fbb3-a426-4d48-a5cc-b6e263995e30",
],
"X-Msedge-Ref": [
"Ref A: 59C38C75B1404B55A084E8EB38DC0136 Ref B: CHI261140501029 Ref C: 2026-03-19T15:58:38Z",
],
"Date": [
"Thu, 19 Mar 2026 15:59:39 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["162"],
"Content-Type": [
"application/json; charset=utf-8",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Request-Id": [
"81a9fbb3-a426-4d48-a5cc-b6e263995e30",
],
"X-Ms-Correlation-Request-Id": [
"81a9fbb3-a426-4d48-a5cc-b6e263995e30",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000c14000>{
s: "{\"error\":{\"code\":\"ProviderError\",\"message\":\"Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'.\"}}",
i: 0,
},
ContentLength: 162,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "%24skiptoken=1Y%2FBaoQwGITf5T9vjLrZbhVKkWWhh0rLunvzEs2vBtckJNGWiu%2Fe0EPpK%2FQ2MwzMfCso%2FPSvUo0O8hXORXW9Ven5VrxDDoP3xuWUTlzxHidUPuJfs8Wo1RN1c%2BNaK42XWjnK4r3IBGYk2acNYdmRkYzxAzk0x8dGdDzJEqTG6kUKtI6WsrXa6c5HFxQv3L8ZVNUgO0%2BH1vya0312PtSfuZFkCSJMPaVxykj8QJKYGIuLxA%2FYdsDtVPS9xZ57FFc9ogr%2Fi0sJux%2FAktsRbYjW%2Bi9jDXn9Xyhr2GD7Bg%3D%3D&api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc0014e61e0>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE: ProviderError
--------------------------------------------------------------------------------
{
"error": {
"code": "ProviderError",
"message": "Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "ProviderError",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T155939Z:81a9fbb3-a426-4d48-a5cc-b6e263995e30",
],
"X-Msedge-Ref": [
"Ref A: 59C38C75B1404B55A084E8EB38DC0136 Ref B: CHI261140501029 Ref C: 2026-03-19T15:58:38Z",
],
"Date": [
"Thu, 19 Mar 2026 15:59:39 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["162"],
"Content-Type": [
"application/json; charset=utf-8",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Request-Id": [
"81a9fbb3-a426-4d48-a5cc-b6e263995e30",
],
"X-Ms-Correlation-Request-Id": [
"81a9fbb3-a426-4d48-a5cc-b6e263995e30",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000c14000>{
s: "{\"error\":{\"code\":\"ProviderError\",\"message\":\"Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'.\"}}",
i: 0,
},
ContentLength: 162,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "%24skiptoken=1Y%2FBaoQwGITf5T9vjLrZbhVKkWWhh0rLunvzEs2vBtckJNGWiu%2Fe0EPpK%2FQ2MwzMfCso%2FPSvUo0O8hXORXW9Ven5VrxDDoP3xuWUTlzxHidUPuJfs8Wo1RN1c%2BNaK42XWjnK4r3IBGYk2acNYdmRkYzxAzk0x8dGdDzJEqTG6kUKtI6WsrXa6c5HFxQv3L8ZVNUgO0%2BH1vya0312PtSfuZFkCSJMPaVxykj8QJKYGIuLxA%2FYdsDtVPS9xZ57FFc9ogr%2Fi0sJux%2FAktsRbYjW%2Bi9jDXn9Xyhr2GD7Bg%3D%3D&api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nilfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000c953e0>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE: ProviderError
--------------------------------------------------------------------------------
{
"error": {
"code": "ProviderError",
"message": "Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "ProviderError",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 19 Mar 2026 10:24:04 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["162"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Request-Id": [
"a16a20c5-d011-43da-ae02-96abf758f533",
],
"X-Ms-Correlation-Request-Id": [
"a16a20c5-d011-43da-ae02-96abf758f533",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T102404Z:a16a20c5-d011-43da-ae02-96abf758f533",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: FD20AB1260094084B33CC10F073A5B77 Ref B: CHI261140514052 Ref C: 2026-03-19T10:23:58Z",
],
"Pragma": ["no-cache"],
},
Body: <*exported.nopClosingBytesReader | 0xc000f9a080>{
s: "{\"error\":{\"code\":\"ProviderError\",\"message\":\"Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'.\"}}",
i: 0,
},
ContentLength: 162,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "%24skiptoken=1Y%2FBaoQwGITf5T9vjLrZbhVKkWWhh0rLunvzEs2vBtckJNGWiu%2Fe0EPpK%2FQ2MwzMfCso%2FPSvUo0O8hXORXW9Ven5VrxDDoP3xuWUTlzxHidUPuJfs8Wo1RN1c%2BNaK42XWjnK4r3IBGYk2acNYdmRkYzxAzk0x8dGdDzJEqTG6kUKtI6WsrXa6c5HFxQv3L8ZVNUgO0%2BH1vya0312PtSfuZFkCSJMPaVxykj8QJKYGIuLxA%2FYdsDtVPS9xZ57FFc9ogr%2Fi0sJux%2FAktsRbYjW%2Bi9jDXn9Xyhr2GD7Bg%3D%3D&api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000c953e0>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE: ProviderError
--------------------------------------------------------------------------------
{
"error": {
"code": "ProviderError",
"message": "Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "ProviderError",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 19 Mar 2026 10:24:04 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["162"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Request-Id": [
"a16a20c5-d011-43da-ae02-96abf758f533",
],
"X-Ms-Correlation-Request-Id": [
"a16a20c5-d011-43da-ae02-96abf758f533",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T102404Z:a16a20c5-d011-43da-ae02-96abf758f533",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: FD20AB1260094084B33CC10F073A5B77 Ref B: CHI261140514052 Ref C: 2026-03-19T10:23:58Z",
],
"Pragma": ["no-cache"],
},
Body: <*exported.nopClosingBytesReader | 0xc000f9a080>{
s: "{\"error\":{\"code\":\"ProviderError\",\"message\":\"Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'.\"}}",
i: 0,
},
ContentLength: 162,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "%24skiptoken=1Y%2FBaoQwGITf5T9vjLrZbhVKkWWhh0rLunvzEs2vBtckJNGWiu%2Fe0EPpK%2FQ2MwzMfCso%2FPSvUo0O8hXORXW9Ven5VrxDDoP3xuWUTlzxHidUPuJfs8Wo1RN1c%2BNaK42XWjnK4r3IBGYk2acNYdmRkYzxAzk0x8dGdDzJEqTG6kUKtI6WsrXa6c5HFxQv3L8ZVNUgO0%2BH1vya0312PtSfuZFkCSJMPaVxykj8QJKYGIuLxA%2FYdsDtVPS9xZ57FFc9ogr%2Fi0sJux%2FAktsRbYjW%2Bi9jDXn9Xyhr2GD7Bg%3D%3D&api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nilfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000f8ea50>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE: ProviderError
--------------------------------------------------------------------------------
{
"error": {
"code": "ProviderError",
"message": "Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "ProviderError",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"d6d059ca-f5bf-439e-bbfd-46f05c53e078",
],
"X-Ms-Correlation-Request-Id": [
"d6d059ca-f5bf-439e-bbfd-46f05c53e078",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 43F7E9279933424097790033A2000E86 Ref B: CHI261140509034 Ref C: 2026-03-19T10:24:59Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["162"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T102559Z:d6d059ca-f5bf-439e-bbfd-46f05c53e078",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Thu, 19 Mar 2026 10:25:59 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0008f6380>{
s: "{\"error\":{\"code\":\"ProviderError\",\"message\":\"Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'.\"}}",
i: 0,
},
ContentLength: 162,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "%24skiptoken=1Y%2FBaoQwGITf5T9vjLrZbhVKkWWhh0rLunvzEs2vBtckJNGWiu%2Fe0EPpK%2FQ2MwzMfCso%2FPSvUo0O8hXORXW9Ven5VrxDDoP3xuWUTlzxHidUPuJfs8Wo1RN1c%2BNaK42XWjnK4r3IBGYk2acNYdmRkYzxAzk0x8dGdDzJEqTG6kUKtI6WsrXa6c5HFxQv3L8ZVNUgO0%2BH1vya0312PtSfuZFkCSJMPaVxykj8QJKYGIuLxA%2FYdsDtVPS9xZ57FFc9ogr%2Fi0sJux%2FAktsRbYjW%2Bi9jDXn9Xyhr2GD7Bg%3D%3D&api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000f8ea50>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE: ProviderError
--------------------------------------------------------------------------------
{
"error": {
"code": "ProviderError",
"message": "Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "ProviderError",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"d6d059ca-f5bf-439e-bbfd-46f05c53e078",
],
"X-Ms-Correlation-Request-Id": [
"d6d059ca-f5bf-439e-bbfd-46f05c53e078",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 43F7E9279933424097790033A2000E86 Ref B: CHI261140509034 Ref C: 2026-03-19T10:24:59Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["162"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T102559Z:d6d059ca-f5bf-439e-bbfd-46f05c53e078",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Thu, 19 Mar 2026 10:25:59 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0008f6380>{
s: "{\"error\":{\"code\":\"ProviderError\",\"message\":\"Resource provider 'Microsoft.RedHatOpenShift' failed to return collection response for type 'HCPOpenShiftClusters'.\"}}",
i: 0,
},
ContentLength: 162,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "%24skiptoken=1Y%2FBaoQwGITf5T9vjLrZbhVKkWWhh0rLunvzEs2vBtckJNGWiu%2Fe0EPpK%2FQ2MwzMfCso%2FPSvUo0O8hXORXW9Ven5VrxDDoP3xuWUTlzxHidUPuJfs8Wo1RN1c%2BNaK42XWjnK4r3IBGYk2acNYdmRkYzxAzk0x8dGdDzJEqTG6kUKtI6WsrXa6c5HFxQv3L8ZVNUgO0%2BH1vya0312PtSfuZFkCSJMPaVxykj8QJKYGIuLxA%2FYdsDtVPS9xZ57FFc9ogr%2Fi0sJux%2FAktsRbYjW%2Bi9jDXn9Xyhr2GD7Bg%3D%3D&api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nilContributing tests (1)
Affected runs (6)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code InternalServerErrorfull failure pattern: ERROR CODE: DeploymentFailed; detail code InternalServerError Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 3 | 7.69%3 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 17 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:80]: Unexpected error:
<*fmt.wrapError | 0xc000a2bd60>:
failed to create customer-infra: failed waiting for deployment "customer-infra-arm64-vm-hcp-cluster-7sdmld" in resourcegroup="arm64-vm-cluster-bhd6ww" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/arm64-vm-cluster-bhd6ww/providers/Microsoft.Resources/deployments/customer-infra-arm64-vm-hcp-cluster-7sdmld/operationStatuses/08584276071679720129
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "InternalServerError",
"message": "{\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T094216Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '9d0d4b1f-6cd4-46ef-9360-db352e410b43', request correlation id '086357ea-a5df-43aa-9ade-32430cd392a8'.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-arm64-vm-hcp-cluster-7sdmld\" in resourcegroup=\"arm64-vm-cluster-bhd6ww\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/arm64-vm-cluster-bhd6ww/providers/Microsoft.Resources/deployments/customer-infra-arm64-vm-hcp-cluster-7sdmld/operationStatuses/08584276071679720129\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094216Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '9d0d4b1f-6cd4-46ef-9360-db352e410b43', request correlation id '086357ea-a5df-43aa-9ade-32430cd392a8'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a2bd40>{
msg: "failed waiting for deployment \"customer-infra-arm64-vm-hcp-cluster-7sdmld\" in resourcegroup=\"arm64-vm-cluster-bhd6ww\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/arm64-vm-cluster-bhd6ww/providers/Microsoft.Resources/deployments/customer-infra-arm64-vm-hcp-cluster-7sdmld/operationStatuses/08584276071679720129\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094216Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '9d0d4b1f-6cd4-46ef-9360-db352e410b43', request correlation id '086357ea-a5df-43aa-9ade-32430cd392a8'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008036e0>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"654f520d-e08b-4b13-9d40-7492126aea91",
],
"X-Content-Type-Options": ["nosniff"],
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:80]: Unexpected error:
<*fmt.wrapError | 0xc000a2bd60>:
failed to create customer-infra: failed waiting for deployment "customer-infra-arm64-vm-hcp-cluster-7sdmld" in resourcegroup="arm64-vm-cluster-bhd6ww" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/arm64-vm-cluster-bhd6ww/providers/Microsoft.Resources/deployments/customer-infra-arm64-vm-hcp-cluster-7sdmld/operationStatuses/08584276071679720129
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "InternalServerError",
"message": "{\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T094216Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '9d0d4b1f-6cd4-46ef-9360-db352e410b43', request correlation id '086357ea-a5df-43aa-9ade-32430cd392a8'.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-arm64-vm-hcp-cluster-7sdmld\" in resourcegroup=\"arm64-vm-cluster-bhd6ww\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/arm64-vm-cluster-bhd6ww/providers/Microsoft.Resources/deployments/customer-infra-arm64-vm-hcp-cluster-7sdmld/operationStatuses/08584276071679720129\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094216Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '9d0d4b1f-6cd4-46ef-9360-db352e410b43', request correlation id '086357ea-a5df-43aa-9ade-32430cd392a8'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a2bd40>{
msg: "failed waiting for deployment \"customer-infra-arm64-vm-hcp-cluster-7sdmld\" in resourcegroup=\"arm64-vm-cluster-bhd6ww\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/arm64-vm-cluster-bhd6ww/providers/Microsoft.Resources/deployments/customer-infra-arm64-vm-hcp-cluster-7sdmld/operationStatuses/08584276071679720129\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094216Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '9d0d4b1f-6cd4-46ef-9360-db352e410b43', request correlation id '086357ea-a5df-43aa-9ade-32430cd392a8'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008036e0>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"654f520d-e08b-4b13-9d40-7492126aea91",
],
"X-Content-Type-Options": ["nosniff"],
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:81]: Unexpected error:
<*fmt.wrapError | 0xc000bc5580>:
failed to create customer-infra: failed waiting for deployment "customer-infra-cluster-np-labels-taints-t59jtk" in resourcegroup="rg-np-labels-taints-gt77vc" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-np-labels-taints-gt77vc/providers/Microsoft.Resources/deployments/customer-infra-cluster-np-labels-taints-t59jtk/operationStatuses/08584276070386670482
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "InternalServerError",
"message": "{\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T094442Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '7da13b4c-2074-4ed2-8674-1b1ea2937fdc', request correlation id '4075b009-7643-490d-b40a-fd5cab0af989'.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-cluster-np-labels-taints-t59jtk\" in resourcegroup=\"rg-np-labels-taints-gt77vc\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-np-labels-taints-gt77vc/providers/Microsoft.Resources/deployments/customer-infra-cluster-np-labels-taints-t59jtk/operationStatuses/08584276070386670482\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094442Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '7da13b4c-2074-4ed2-8674-1b1ea2937fdc', request correlation id '4075b009-7643-490d-b40a-fd5cab0af989'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000bc5560>{
msg: "failed waiting for deployment \"customer-infra-cluster-np-labels-taints-t59jtk\" in resourcegroup=\"rg-np-labels-taints-gt77vc\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-np-labels-taints-gt77vc/providers/Microsoft.Resources/deployments/customer-infra-cluster-np-labels-taints-t59jtk/operationStatuses/08584276070386670482\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094442Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '7da13b4c-2074-4ed2-8674-1b1ea2937fdc', request correlation id '4075b009-7643-490d-b40a-fd5cab0af989'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011eaea0>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"af79b60e-5587-4117-9e37-523f09825369",
],
"Date": [
"Fri, 20 Mar 2026 09:44:49 GMT",
],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:81]: Unexpected error:
<*fmt.wrapError | 0xc000bc5580>:
failed to create customer-infra: failed waiting for deployment "customer-infra-cluster-np-labels-taints-t59jtk" in resourcegroup="rg-np-labels-taints-gt77vc" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-np-labels-taints-gt77vc/providers/Microsoft.Resources/deployments/customer-infra-cluster-np-labels-taints-t59jtk/operationStatuses/08584276070386670482
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "InternalServerError",
"message": "{\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T094442Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '7da13b4c-2074-4ed2-8674-1b1ea2937fdc', request correlation id '4075b009-7643-490d-b40a-fd5cab0af989'.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-cluster-np-labels-taints-t59jtk\" in resourcegroup=\"rg-np-labels-taints-gt77vc\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-np-labels-taints-gt77vc/providers/Microsoft.Resources/deployments/customer-infra-cluster-np-labels-taints-t59jtk/operationStatuses/08584276070386670482\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094442Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '7da13b4c-2074-4ed2-8674-1b1ea2937fdc', request correlation id '4075b009-7643-490d-b40a-fd5cab0af989'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000bc5560>{
msg: "failed waiting for deployment \"customer-infra-cluster-np-labels-taints-t59jtk\" in resourcegroup=\"rg-np-labels-taints-gt77vc\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-np-labels-taints-gt77vc/providers/Microsoft.Resources/deployments/customer-infra-cluster-np-labels-taints-t59jtk/operationStatuses/08584276070386670482\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094442Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '7da13b4c-2074-4ed2-8674-1b1ea2937fdc', request correlation id '4075b009-7643-490d-b40a-fd5cab0af989'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011eaea0>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"af79b60e-5587-4117-9e37-523f09825369",
],
"Date": [
"Fri, 20 Mar 2026 09:44:49 GMT",
],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:85]: Unexpected error:
<*fmt.wrapError | 0xc000f82360>:
failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cluster-zstream-4-19-6fd9wv-x2gpnw" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "InternalServerError",
"message": "{\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T094914Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f9637488-a80a-49b4-9d85-d6a0f597d8f4', request correlation id 'c6f7a3ea-7476-48bb-9fbd-25ee8524741c'.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create managed identities: failed to create managed identities: failed waiting for deployment \"mi-cluster-zstream-4-19-6fd9wv-x2gpnw\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094914Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f9637488-a80a-49b4-9d85-d6a0f597d8f4', request correlation id 'c6f7a3ea-7476-48bb-9fbd-25ee8524741c'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f82340>{
msg: "failed to create managed identities: failed waiting for deployment \"mi-cluster-zstream-4-19-6fd9wv-x2gpnw\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094914Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f9637488-a80a-49b4-9d85-d6a0f597d8f4', request correlation id 'c6f7a3ea-7476-48bb-9fbd-25ee8524741c'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f82320>{
msg: "failed waiting for deployment \"mi-cluster-zstream-4-19-6fd9wv-x2gpnw\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:85]: Unexpected error:
<*fmt.wrapError | 0xc000f82360>:
failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cluster-zstream-4-19-6fd9wv-x2gpnw" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "InternalServerError",
"message": "{\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T094914Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f9637488-a80a-49b4-9d85-d6a0f597d8f4', request correlation id 'c6f7a3ea-7476-48bb-9fbd-25ee8524741c'.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create managed identities: failed to create managed identities: failed waiting for deployment \"mi-cluster-zstream-4-19-6fd9wv-x2gpnw\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094914Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f9637488-a80a-49b4-9d85-d6a0f597d8f4', request correlation id 'c6f7a3ea-7476-48bb-9fbd-25ee8524741c'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f82340>{
msg: "failed to create managed identities: failed waiting for deployment \"mi-cluster-zstream-4-19-6fd9wv-x2gpnw\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T094914Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f9637488-a80a-49b4-9d85-d6a0f597d8f4', request correlation id 'c6f7a3ea-7476-48bb-9fbd-25ee8524741c'.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f82320>{
msg: "failed waiting for deployment \"mi-cluster-zstream-4-19-6fd9wv-x2gpnw\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-19-6fd9wv-x2gpnw/operationStatuses/08584276067733222695\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (13)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | e2e | 3 | 7.69%3 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 4 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapErrors | 0xc0009b8840>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-jmwp7b, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-jmwp7b" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-jmwp7b, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-jmwp7b\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0005a92b0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-jmwp7b",
},
<*fmt.wrapError | 0xc001396680>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-jmwp7b\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapErrors | 0xc0009b8840>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-jmwp7b, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-jmwp7b" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-jmwp7b, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-jmwp7b\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0005a92b0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-jmwp7b",
},
<*fmt.wrapError | 0xc001396680>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-jmwp7b\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:123]: Unexpected error:
<*fmt.wrapErrors | 0xc0013fc0c0>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group tls-endpoint-cluster-k8q47m, error: failed waiting for nodepool="np-1" for cluster "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-k8q47m" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group tls-endpoint-cluster-k8q47m, error: failed waiting for nodepool=\"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-k8q47m\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00150edc0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group tls-endpoint-cluster-k8q47m",
},
<*fmt.wrapError | 0xc000c84460>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-k8q47m\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:123]: Unexpected error:
<*fmt.wrapErrors | 0xc0013fc0c0>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group tls-endpoint-cluster-k8q47m, error: failed waiting for nodepool="np-1" for cluster "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-k8q47m" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group tls-endpoint-cluster-k8q47m, error: failed waiting for nodepool=\"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-k8q47m\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00150edc0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group tls-endpoint-cluster-k8q47m",
},
<*fmt.wrapError | 0xc000c84460>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-k8q47m\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapErrors | 0xc00092ae70>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-t7lnhv, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t7lnhv" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-t7lnhv, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t7lnhv\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001288490>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-t7lnhv",
},
<*fmt.wrapError | 0xc000960c40>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t7lnhv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapErrors | 0xc00092ae70>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-t7lnhv, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t7lnhv" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-t7lnhv, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t7lnhv\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001288490>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-t7lnhv",
},
<*fmt.wrapError | 0xc000960c40>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t7lnhv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredContributing tests (3)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.13%2 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 15: 0 · Mar 16: 7 · Mar 17: 0 · Mar 18: 11 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:95]: Unexpected error:
<*fmt.wrapError | 0xc000962220>:
failed to create HCP cluster cluster-zstream-4-20-hfk97l: failed waiting for cluster="cluster-zstream-4-20-hfk97l" in resourcegroup="rg-zstream-upgrade-4-20-6jjt78" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49",
"name": "a535b9a7-79bf-4ae9-99b6-679319213e49",
"status": "Failed",
"startTime": "2026-03-18T22:10:00.515143027Z",
"endTime": "2026-03-18T22:11:58.502121438Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cluster-zstream-4-20-hfk97l: failed waiting for cluster=\"cluster-zstream-4-20-hfk97l\" in resourcegroup=\"rg-zstream-upgrade-4-20-6jjt78\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"name\": \"a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.515143027Z\",\n \"endTime\": \"2026-03-18T22:11:58.502121438Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009621e0>{
msg: "failed waiting for cluster=\"cluster-zstream-4-20-hfk97l\" in resourcegroup=\"rg-zstream-upgrade-4-20-6jjt78\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"name\": \"a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.515143027Z\",\n \"endTime\": \"2026-03-18T22:11:58.502121438Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e803c0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/a23e4d00-7c12-428e-b637-d6e87c428e63",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260318T221203Z:86a9a285-d268-4eaa-81f2-1b43b6865e4f",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["503"],
"X-Envoy-Upstream-Service-Time": ["10"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"86a9a285-d268-4eaa-81f2-1b43b6865e4f",
],
"X-Msedge-Ref": [
"Ref A: 30110B94D9A9488595249B68A2A891EF Ref B: CHI261140505062 Ref C: 2026-03-18T22:12:03Z",
],
"Date": [
"Wed, 18 Mar 2026 22:12...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:95]: Unexpected error:
<*fmt.wrapError | 0xc000962220>:
failed to create HCP cluster cluster-zstream-4-20-hfk97l: failed waiting for cluster="cluster-zstream-4-20-hfk97l" in resourcegroup="rg-zstream-upgrade-4-20-6jjt78" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49",
"name": "a535b9a7-79bf-4ae9-99b6-679319213e49",
"status": "Failed",
"startTime": "2026-03-18T22:10:00.515143027Z",
"endTime": "2026-03-18T22:11:58.502121438Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cluster-zstream-4-20-hfk97l: failed waiting for cluster=\"cluster-zstream-4-20-hfk97l\" in resourcegroup=\"rg-zstream-upgrade-4-20-6jjt78\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"name\": \"a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.515143027Z\",\n \"endTime\": \"2026-03-18T22:11:58.502121438Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009621e0>{
msg: "failed waiting for cluster=\"cluster-zstream-4-20-hfk97l\" in resourcegroup=\"rg-zstream-upgrade-4-20-6jjt78\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"name\": \"a535b9a7-79bf-4ae9-99b6-679319213e49\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.515143027Z\",\n \"endTime\": \"2026-03-18T22:11:58.502121438Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e803c0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/a23e4d00-7c12-428e-b637-d6e87c428e63",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260318T221203Z:86a9a285-d268-4eaa-81f2-1b43b6865e4f",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["503"],
"X-Envoy-Upstream-Service-Time": ["10"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"86a9a285-d268-4eaa-81f2-1b43b6865e4f",
],
"X-Msedge-Ref": [
"Ref A: 30110B94D9A9488595249B68A2A891EF Ref B: CHI261140505062 Ref C: 2026-03-18T22:12:03Z",
],
"Date": [
"Wed, 18 Mar 2026 22:12...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapError | 0xc000a8e6a0>:
failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-fncbll" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b",
"name": "1dcfdab9-27df-483f-a009-42303866394b",
"status": "Failed",
"startTime": "2026-03-18T22:10:00.698917174Z",
"endTime": "2026-03-18T22:12:23.691383966Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-fncbll\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\",\n \"name\": \"1dcfdab9-27df-483f-a009-42303866394b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.698917174Z\",\n \"endTime\": \"2026-03-18T22:12:23.691383966Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a8e680>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-fncbll\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\",\n \"name\": \"1dcfdab9-27df-483f-a009-42303866394b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.698917174Z\",\n \"endTime\": \"2026-03-18T22:12:23.691383966Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00094b230>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["503"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"ee86427e-005d-4cc8-bd01-2b82a0056536",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260318T221233Z:a23b9d02-f439-4d75-bcef-bec5f70b2688",
],
"X-Msedge-Ref": [
"Ref A: 2529055C24EC4D90ABA73CA7E8A5F278 Ref B: CHI261140504054 Ref C: 2026-03-18T22:12:33Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Ms-Correlation-Request-Id": [
"a23b9d02-f439-4d75-bcef-bec5f70b2688",
],
"Strict-Transport-Security": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapError | 0xc000a8e6a0>:
failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-fncbll" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b",
"name": "1dcfdab9-27df-483f-a009-42303866394b",
"status": "Failed",
"startTime": "2026-03-18T22:10:00.698917174Z",
"endTime": "2026-03-18T22:12:23.691383966Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-fncbll\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\",\n \"name\": \"1dcfdab9-27df-483f-a009-42303866394b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.698917174Z\",\n \"endTime\": \"2026-03-18T22:12:23.691383966Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a8e680>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-fncbll\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/1dcfdab9-27df-483f-a009-42303866394b\",\n \"name\": \"1dcfdab9-27df-483f-a009-42303866394b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:10:00.698917174Z\",\n \"endTime\": \"2026-03-18T22:12:23.691383966Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00094b230>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["503"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"ee86427e-005d-4cc8-bd01-2b82a0056536",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260318T221233Z:a23b9d02-f439-4d75-bcef-bec5f70b2688",
],
"X-Msedge-Ref": [
"Ref A: 2529055C24EC4D90ABA73CA7E8A5F278 Ref B: CHI261140504054 Ref C: 2026-03-18T22:12:33Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Ms-Correlation-Request-Id": [
"a23b9d02-f439-4d75-bcef-bec5f70b2688",
],
"Strict-Transport-Security": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
<*fmt.wrapError | 0xc000b943a0>:
failed to create HCP cluster ea-list8n6lb4: failed waiting for cluster="ea-list8n6lb4" in resourcegroup="ea-list-gwfwm5" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130",
"name": "b5aa74e8-43d5-4cff-b520-63b6b9163130",
"status": "Failed",
"startTime": "2026-03-18T21:58:12.305820102Z",
"endTime": "2026-03-18T21:59:35.853803496Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-list8n6lb4: failed waiting for cluster=\"ea-list8n6lb4\" in resourcegroup=\"ea-list-gwfwm5\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"name\": \"b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T21:58:12.305820102Z\",\n \"endTime\": \"2026-03-18T21:59:35.853803496Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000b94380>{
msg: "failed waiting for cluster=\"ea-list8n6lb4\" in resourcegroup=\"ea-list-gwfwm5\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"name\": \"b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T21:58:12.305820102Z\",\n \"endTime\": \"2026-03-18T21:59:35.853803496Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011866c0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260318T215943Z:3c196c67-a4c1-40eb-abc4-c5d8f5d91317",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 18 Mar 2026 21:59:43 GMT",
],
"Pragma": ["no-cache"],
"X-Ms-Request-Id": [
"e2863777-8b30-4013-8910-cf48bfc93c57",
],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Msedge-Ref": [
"Ref A: 694EB5D5CF094E458C2CC1B85768A697 Ref B: CHI261140510060 Ref C: 2026-03-18T21:59:43Z",
],
"Content-Length": ["503"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Expires...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
<*fmt.wrapError | 0xc000b943a0>:
failed to create HCP cluster ea-list8n6lb4: failed waiting for cluster="ea-list8n6lb4" in resourcegroup="ea-list-gwfwm5" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130",
"name": "b5aa74e8-43d5-4cff-b520-63b6b9163130",
"status": "Failed",
"startTime": "2026-03-18T21:58:12.305820102Z",
"endTime": "2026-03-18T21:59:35.853803496Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-list8n6lb4: failed waiting for cluster=\"ea-list8n6lb4\" in resourcegroup=\"ea-list-gwfwm5\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"name\": \"b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T21:58:12.305820102Z\",\n \"endTime\": \"2026-03-18T21:59:35.853803496Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000b94380>{
msg: "failed waiting for cluster=\"ea-list8n6lb4\" in resourcegroup=\"ea-list-gwfwm5\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"name\": \"b5aa74e8-43d5-4cff-b520-63b6b9163130\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T21:58:12.305820102Z\",\n \"endTime\": \"2026-03-18T21:59:35.853803496Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011866c0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260318T215943Z:3c196c67-a4c1-40eb-abc4-c5d8f5d91317",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 18 Mar 2026 21:59:43 GMT",
],
"Pragma": ["no-cache"],
"X-Ms-Request-Id": [
"e2863777-8b30-4013-8910-cf48bfc93c57",
],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Msedge-Ref": [
"Ref A: 694EB5D5CF094E458C2CC1B85768A697 Ref B: CHI261140510060 Ref C: 2026-03-18T21:59:43Z",
],
"Content-Length": ["503"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Expires...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (13)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.13%2 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 15: 0 · Mar 16: 9 · Mar 17: 0 · Mar 18: 7 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:96]: Unexpected error:
<*fmt.wrapErrors | 0xc000e6cb10>:
failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-vm79bx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: context deadline exceeded
{
msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-vm79bx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011648c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx",
},
<*fmt.wrapErrors | 0xc000e6cae0>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-vm79bx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011648c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:96]: Unexpected error:
<*fmt.wrapErrors | 0xc000e6cb10>:
failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-vm79bx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: context deadline exceeded
{
msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-vm79bx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011648c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx",
},
<*fmt.wrapErrors | 0xc000e6cae0>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-vm79bx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011648c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-vm79bx",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapErrors | 0xc00101e2d0>:
failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-nxd528" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: context deadline exceeded
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-nxd528\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001374460>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528",
},
<*fmt.wrapErrors | 0xc00101e2a0>{
msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-nxd528\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001374460>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapErrors | 0xc00101e2d0>:
failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-nxd528" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: context deadline exceeded
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-nxd528\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001374460>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528",
},
<*fmt.wrapErrors | 0xc00101e2a0>{
msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-nxd528\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001374460>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-nxd528",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
<*fmt.wrapErrors | 0xc00142ccf0>:
failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-sjngpl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: context deadline exceeded
{
msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-sjngpl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00158dc10>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl",
},
<*fmt.wrapErrors | 0xc00142ccc0>{
msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-sjngpl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00158dc10>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
<*fmt.wrapErrors | 0xc00142ccf0>:
failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-sjngpl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: context deadline exceeded
{
msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-sjngpl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00158dc10>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl",
},
<*fmt.wrapErrors | 0xc00142ccc0>{
msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-sjngpl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00158dc10>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-sjngpl",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (11)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.13%2 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 1 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s) | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s) | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 1 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47]: Interrupted by User Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: ResourceGroupDeletionFailedfull failure pattern: ERROR CODE: ResourceGroupDeletionFailed Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 1 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000a84948>:
failed to cleanup resource group: failed waiting for resourcegroup="np-autoscaling-hsrbbh" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJESFNSQkJILUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'np-autoscaling-hsrbbh' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc0006c30a0>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"np-autoscaling-hsrbbh\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJESFNSQkJILUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-hsrbbh' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0006c3080>{
msg: "failed waiting for resourcegroup=\"np-autoscaling-hsrbbh\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJESFNSQkJILUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-hsrbbh' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00092b0b0>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T034906Z:75f74363-b48d-43af-b448-6066e54e30d1",
],
"Content-Length": ["240"],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Request-Id": [
"75f74363-b48d-43af-b448-6066e54e30d1",
],
"Date": [
"Thu, 19 Mar 2026 03:49:05 GMT",
],
"Cache-Control": ["no-cache"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"75f74363-b48d-43af-b448-6066e54e30d1",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000a84948>:
failed to cleanup resource group: failed waiting for resourcegroup="np-autoscaling-hsrbbh" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJESFNSQkJILUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'np-autoscaling-hsrbbh' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc0006c30a0>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"np-autoscaling-hsrbbh\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJESFNSQkJILUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-hsrbbh' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0006c3080>{
msg: "failed waiting for resourcegroup=\"np-autoscaling-hsrbbh\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJESFNSQkJILUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-hsrbbh' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00092b0b0>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260319T034906Z:75f74363-b48d-43af-b448-6066e54e30d1",
],
"Content-Length": ["240"],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Request-Id": [
"75f74363-b48d-43af-b448-6066e54e30d1",
],
"Date": [
"Thu, 19 Mar 2026 03:49:05 GMT",
],
"Cache-Control": ["no-cache"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"75f74363-b48d-43af-b448-6066e54e30d1",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: AuthorizationFailedfull failure pattern: ERROR CODE: AuthorizationFailed Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:81]: Unexpected error:
<*fmt.wrapError | 0xc001504fc0>:
failed to create customer-infra: failed waiting for deployment "customer-infra-basic-hcp-cluster-7hz8zk" in resourcegroup="customer-rg-clsh4k" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609
--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: AuthorizationFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "AuthorizationFailed",
"message": "The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Resources/deployments/operationStatuses/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609' or the scope is invalid. If access was recently granted, please refresh your credentials."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-basic-hcp-cluster-7hz8zk\" in resourcegroup=\"customer-rg-clsh4k\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Resources/deployments/operationStatuses/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc001504fa0>{
msg: "failed waiting for deployment \"customer-infra-basic-hcp-cluster-7hz8zk\" in resourcegroup=\"customer-rg-clsh4k\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Resources/deployments/operationStatuses/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014bb1a0>{
ErrorCode: "AuthorizationFailed",
StatusCode: 403,
RawResponse: {
Status: "403 Forbidden",
StatusCode: 403,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Correlation-Request-Id": [
"06490acc-bbf6-4428-8144-e61db004ace3",
],
"X-Ms-Routing-Request-Id": [
"EASTUS2EUAP:20260316T060848Z:06490acc-bbf6-4428-8144-e61db004ace3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["569"],
"Content-Type": [
"applic...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:81]: Unexpected error:
<*fmt.wrapError | 0xc001504fc0>:
failed to create customer-infra: failed waiting for deployment "customer-infra-basic-hcp-cluster-7hz8zk" in resourcegroup="customer-rg-clsh4k" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609
--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: AuthorizationFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "AuthorizationFailed",
"message": "The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Resources/deployments/operationStatuses/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609' or the scope is invalid. If access was recently granted, please refresh your credentials."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-basic-hcp-cluster-7hz8zk\" in resourcegroup=\"customer-rg-clsh4k\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Resources/deployments/operationStatuses/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc001504fa0>{
msg: "failed waiting for deployment \"customer-infra-basic-hcp-cluster-7hz8zk\" in resourcegroup=\"customer-rg-clsh4k\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Resources/deployments/operationStatuses/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/customer-rg-clsh4k/providers/Microsoft.Resources/deployments/customer-infra-basic-hcp-cluster-7hz8zk/operationStatuses/08584279655981786609' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014bb1a0>{
ErrorCode: "AuthorizationFailed",
StatusCode: 403,
RawResponse: {
Status: "403 Forbidden",
StatusCode: 403,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Correlation-Request-Id": [
"06490acc-bbf6-4428-8144-e61db004ace3",
],
"X-Ms-Routing-Request-Id": [
"EASTUS2EUAP:20260316T060848Z:06490acc-bbf6-4428-8144-e61db004ace3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["569"],
"Content-Type": [
"applic...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization to perform action 'Microsoft....full failure pattern: ERROR CODE: AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/<resource>' over scope '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials.; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0008f2c20>:
failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-rkr4r8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128
--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: AuthorizationFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "AuthorizationFailed",
"message": "The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/write' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-rkr4r8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/write' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008f2c00>{
msg: "failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-rkr4r8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/write' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014046f0>{
ErrorCode: "AuthorizationFailed",
StatusCode: 403,
RawResponse: {
Status: "403 Forbidden",
StatusCode: 403,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["523"],
"X-Ms-Correlation-Request-Id": [
"2935921b-184b-4fc2-9c09-4c26121abf36",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 16 Mar 2026 05:50:31 GMT",
],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Request-Id": [
"2935921b-184b-4fc2-9c09-4c26121abf36",
],
"X-Ms-Routing-Request-Id": [
"EASTUS2EUAP:20260316T055032Z:2935921b-184b-4fc2-9c09-4c26121abf36",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0008f2c20>:
failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-rkr4r8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128
--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: AuthorizationFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "AuthorizationFailed",
"message": "The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/write' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-rkr4r8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/write' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008f2c00>{
msg: "failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-rkr4r8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 Forbidden\nERROR CODE: AuthorizationFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"AuthorizationFailed\",\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.RedHatOpenShift/hcpOpenShiftClusters/write' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-rkr4r8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014046f0>{
ErrorCode: "AuthorizationFailed",
StatusCode: 403,
RawResponse: {
Status: "403 Forbidden",
StatusCode: 403,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["523"],
"X-Ms-Correlation-Request-Id": [
"2935921b-184b-4fc2-9c09-4c26121abf36",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 16 Mar 2026 05:50:31 GMT",
],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Request-Id": [
"2935921b-184b-4fc2-9c09-4c26121abf36",
],
"X-Ms-Routing-Request-Id": [
"EASTUS2EUAP:20260316T055032Z:2935921b-184b-4fc2-9c09-4c26121abf36",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization...full failure pattern: ERROR CODE: DeploymentFailed; detail code AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/<resource>' over scope '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0004993c0>:
failed to create customer-infra: failed waiting for deployment "customer-infra-ea-cluster-lqkgx2" in resourcegroup="external-auth-cluster-rhfph2" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Resources/deployments/customer-infra-ea-cluster-lqkgx2/operationStatuses/08584279665118667979
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Forbidden",
"message": "{\r\n \"error\": {\r\n \"code\": \"AuthorizationFailed\",\r\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-ea-cluster-lqkgx2\" in resourcegroup=\"external-auth-cluster-rhfph2\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Resources/deployments/customer-infra-ea-cluster-lqkgx2/operationStatuses/08584279665118667979\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000499380>{
msg: "failed waiting for deployment \"customer-infra-ea-cluster-lqkgx2\" in resourcegroup=\"external-auth-cluster-rhfph2\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Resources/deployments/customer-infra-ea-cluster-lqkgx2/operationStatuses/08584279665118667979\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000baa6f0>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0004993c0>:
failed to create customer-infra: failed waiting for deployment "customer-infra-ea-cluster-lqkgx2" in resourcegroup="external-auth-cluster-rhfph2" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Resources/deployments/customer-infra-ea-cluster-lqkgx2/operationStatuses/08584279665118667979
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Forbidden",
"message": "{\r\n \"error\": {\r\n \"code\": \"AuthorizationFailed\",\r\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-ea-cluster-lqkgx2\" in resourcegroup=\"external-auth-cluster-rhfph2\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Resources/deployments/customer-infra-ea-cluster-lqkgx2/operationStatuses/08584279665118667979\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000499380>{
msg: "failed waiting for deployment \"customer-infra-ea-cluster-lqkgx2\" in resourcegroup=\"external-auth-cluster-rhfph2\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Resources/deployments/customer-infra-ea-cluster-lqkgx2/operationStatuses/08584279665118667979\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/networkSecurityGroups/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/external-auth-cluster-rhfph2/providers/Microsoft.Network/networkSecurityGroups/customer-nsg' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000baa6f0>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization...full failure pattern: ERROR CODE: DeploymentFailed; detail code AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/<resource>' over scope '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:74]: Unexpected error:
<*fmt.wrapError | 0xc00093d060>:
failed to create customer-infra: failed waiting for deployment "customer-infra-np-autoscale-cluster-5pp8qh" in resourcegroup="np-autoscaling-l7brcq" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Resources/deployments/customer-infra-np-autoscale-cluster-5pp8qh/operationStatuses/08584279658982549597
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Forbidden",
"message": "{\r\n \"error\": {\r\n \"code\": \"AuthorizationFailed\",\r\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-np-autoscale-cluster-5pp8qh\" in resourcegroup=\"np-autoscaling-l7brcq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Resources/deployments/customer-infra-np-autoscale-cluster-5pp8qh/operationStatuses/08584279658982549597\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00093d020>{
msg: "failed waiting for deployment \"customer-infra-np-autoscale-cluster-5pp8qh\" in resourcegroup=\"np-autoscaling-l7brcq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Resources/deployments/customer-infra-np-autoscale-cluster-5pp8qh/operationStatuses/08584279658982549597\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008efc50>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Msedge-Ref": [
"Ref A: ED37EB9E1FA645FA954684A176851865 Ref B: CH1AA2020620045 Ref C: 2026-03-16T06:05:39Z",
],
"Date": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:74]: Unexpected error:
<*fmt.wrapError | 0xc00093d060>:
failed to create customer-infra: failed waiting for deployment "customer-infra-np-autoscale-cluster-5pp8qh" in resourcegroup="np-autoscaling-l7brcq" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Resources/deployments/customer-infra-np-autoscale-cluster-5pp8qh/operationStatuses/08584279658982549597
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Forbidden",
"message": "{\r\n \"error\": {\r\n \"code\": \"AuthorizationFailed\",\r\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-np-autoscale-cluster-5pp8qh\" in resourcegroup=\"np-autoscaling-l7brcq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Resources/deployments/customer-infra-np-autoscale-cluster-5pp8qh/operationStatuses/08584279658982549597\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00093d020>{
msg: "failed waiting for deployment \"customer-infra-np-autoscale-cluster-5pp8qh\" in resourcegroup=\"np-autoscaling-l7brcq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Resources/deployments/customer-infra-np-autoscale-cluster-5pp8qh/operationStatuses/08584279658982549597\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/np-autoscaling-l7brcq/providers/Microsoft.Network/virtualNetworks/customer-vnet' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008efc50>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Msedge-Ref": [
"Ref A: ED37EB9E1FA645FA954684A176851865 Ref B: CH1AA2020620045 Ref C: 2026-03-16T06:05:39Z",
],
"Date": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization...full failure pattern: ERROR CODE: DeploymentFailed; detail code AuthorizationFailed; detail message The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '<uuid>' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/<resource>' over scope '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000760480>:
failed to create customer-infra: failed waiting for deployment "customer-infra-basic-cluster-wk5cgh" in resourcegroup="rg-cluster-nsg-subnet-reuse-dvvbjq" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Resources/deployments/customer-infra-basic-cluster-wk5cgh/operationStatuses/08584279668585153729
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Forbidden",
"message": "{\r\n \"error\": {\r\n \"code\": \"AuthorizationFailed\",\r\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-basic-cluster-wk5cgh\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-dvvbjq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Resources/deployments/customer-infra-basic-cluster-wk5cgh/operationStatuses/08584279668585153729\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000760460>{
msg: "failed waiting for deployment \"customer-infra-basic-cluster-wk5cgh\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-dvvbjq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Resources/deployments/customer-infra-basic-cluster-wk5cgh/operationStatuses/08584279668585153729\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0012bd110>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Length": ["839"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000760480>:
failed to create customer-infra: failed waiting for deployment "customer-infra-basic-cluster-wk5cgh" in resourcegroup="rg-cluster-nsg-subnet-reuse-dvvbjq" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Resources/deployments/customer-infra-basic-cluster-wk5cgh/operationStatuses/08584279668585153729
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Forbidden",
"message": "{\r\n \"error\": {\r\n \"code\": \"AuthorizationFailed\",\r\n \"message\": \"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.\"\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create customer-infra: failed waiting for deployment \"customer-infra-basic-cluster-wk5cgh\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-dvvbjq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Resources/deployments/customer-infra-basic-cluster-wk5cgh/operationStatuses/08584279668585153729\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000760460>{
msg: "failed waiting for deployment \"customer-infra-basic-cluster-wk5cgh\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-dvvbjq\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Resources/deployments/customer-infra-basic-cluster-wk5cgh/operationStatuses/08584279668585153729\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Forbidden\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"AuthorizationFailed\\\",\\r\\n \\\"message\\\": \\\"The client 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' with object id '0e96dbb7-17a2-4393-b2d3-d84524e39c32' does not have authorization to perform action 'Microsoft.Network/virtualNetworks/read' over scope '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/rg-cluster-nsg-subnet-reuse-dvvbjq/providers/Microsoft.Network/virtualNetworks/customer-vnet-name1' or the scope is invalid. If access was recently granted, please refresh your credentials.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0012bd110>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Length": ["839"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.ManagedIdentityfull failure pattern: ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.ManagedIdentity Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 1 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:81]: Unexpected error:
<*fmt.wrapError | 0xc0016053a0>:
failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-basic-hcp-cluster-9d7jkm" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-basic-hcp-cluster-9d7jkm/operationStatuses/08584276114880859088
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-jg7phn/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-eqbgltuyzhpg4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083028Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'a7739b02-f190-492e-b6ca-5904c97135c6', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/dp-file-csi-driver\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '0ec4bb4f-3c7a-4a85-9ef0-62497151a6f0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '5fcbd0fd-49b3-4339-b567-de1c1596aaa0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '92858e8c-aa82-4d12-af4e-bbaf740beedc', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083026Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '5aedb7a4-fd70-4e59-8a0f-c36fcb99fe4a', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083026Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '6ad7864e-528a-4bd7-a91c-c7eead01227a', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083025Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'b474b493-2d00-4cd4-8b16-04c1849437da', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083024Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'e178a66f-7a87-4e67-8562-6aafb6036181', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083023Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'e59eefa1-b6f0-4d97-8d61-9506dc6c5ff4', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create managed identities: failed to create managed identities: failed waiting for deployment \"mi-basic-hcp-cluster-9d7jkm\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-basic-hcp-cluster-9d7jkm/operationStatuses/08584276114880859088\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-jg7phn/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-eqbgltuyzhpg4\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T083028Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'a7739b02-f190-492e-b6ca-5904c97135c6', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\\\"\\r\\n },\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/dp-file-csi-driver\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '0ec4bb4f-3c7a-4a85-9ef0-62497151a6f0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\\\"\\r\\n },\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '5fcbd0fd-49b3-4339-b567-de1c1596aaa0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\\\"\\r\\n },\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\\\",\\r\\n \\\"message\\\": \\\"En...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:81]: Unexpected error:
<*fmt.wrapError | 0xc0016053a0>:
failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-basic-hcp-cluster-9d7jkm" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-basic-hcp-cluster-9d7jkm/operationStatuses/08584276114880859088
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-jg7phn/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-eqbgltuyzhpg4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083028Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'a7739b02-f190-492e-b6ca-5904c97135c6', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/dp-file-csi-driver\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '0ec4bb4f-3c7a-4a85-9ef0-62497151a6f0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '5fcbd0fd-49b3-4339-b567-de1c1596aaa0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '92858e8c-aa82-4d12-af4e-bbaf740beedc', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083026Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '5aedb7a4-fd70-4e59-8a0f-c36fcb99fe4a', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083026Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '6ad7864e-528a-4bd7-a91c-c7eead01227a', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083025Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'b474b493-2d00-4cd4-8b16-04c1849437da', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083024Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'e178a66f-7a87-4e67-8562-6aafb6036181', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n },\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms\",\r\n \"message\": \"Encountered internal server error. Diagnostic information: timestamp '20260320T083023Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'e59eefa1-b6f0-4d97-8d61-9506dc6c5ff4', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create managed identities: failed to create managed identities: failed waiting for deployment \"mi-basic-hcp-cluster-9d7jkm\" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-basic-hcp-cluster-9d7jkm/operationStatuses/08584276114880859088\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-jg7phn/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-eqbgltuyzhpg4\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T083028Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'a7739b02-f190-492e-b6ca-5904c97135c6', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\\\"\\r\\n },\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/dp-file-csi-driver\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '0ec4bb4f-3c7a-4a85-9ef0-62497151a6f0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\\\"\\r\\n },\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260320T083027Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '5fcbd0fd-49b3-4339-b567-de1c1596aaa0', request correlation id '6c19fc94-efec-4cab-8d4f-81ceaf7a1471'.\\\"\\r\\n },\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-107/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\\\",\\r\\n \\\"message\\\": \\\"En...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: MultipleErrorsOccurred; detail code InternalServerError; detail message ClientCertificateCredential: unable to resolve an endpoint: server response error: context dead...full failure pattern: ERROR CODE: MultipleErrorsOccurred; detail code InternalServerError; detail message ClientCertificateCredential: unable to resolve an endpoint: server response error: context deadline exceeded; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 1 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc001828480>:
failed to create HCP cluster patch-name-cluster: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-99xb7j" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: MultipleErrorsOccurred
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b",
"name": "6e36926c-e6c5-49f7-a607-9f56a4bbb73b",
"status": "Failed",
"startTime": "2026-03-18T22:05:01.130113225Z",
"endTime": "2026-03-18T22:06:29.307118365Z",
"error": {
"code": "MultipleErrorsOccurred",
"message": "Cluster provisioning failed due to multiple errors",
"details": [
{
"code": "InternalServerError",
"message": "Failed to verify existence of managed resource group 'patch-name-99xb7j--managed': ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "failed to get quota usage data: ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-99xb7j\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"name\": \"6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:05:01.130113225Z\",\n \"endTime\": \"2026-03-18T22:06:29.307118365Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to verify existence of managed resource group 'patch-name-99xb7j--managed': ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to get quota usage data: ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc001828460>{
msg: "failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-99xb7j\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"name\": \"6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:05:01.130113225Z\",\n \"endTime\": \"2026-03-18T22:06:29.307118365Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to verify existence of managed resource group 'patch-name-99xb7j--managed': ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerErro...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc001828480>:
failed to create HCP cluster patch-name-cluster: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-99xb7j" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: MultipleErrorsOccurred
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b",
"name": "6e36926c-e6c5-49f7-a607-9f56a4bbb73b",
"status": "Failed",
"startTime": "2026-03-18T22:05:01.130113225Z",
"endTime": "2026-03-18T22:06:29.307118365Z",
"error": {
"code": "MultipleErrorsOccurred",
"message": "Cluster provisioning failed due to multiple errors",
"details": [
{
"code": "InternalServerError",
"message": "Failed to verify existence of managed resource group 'patch-name-99xb7j--managed': ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "failed to get quota usage data: ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-99xb7j\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"name\": \"6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:05:01.130113225Z\",\n \"endTime\": \"2026-03-18T22:06:29.307118365Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to verify existence of managed resource group 'patch-name-99xb7j--managed': ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to get quota usage data: ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc001828460>{
msg: "failed waiting for cluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-99xb7j\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"name\": \"6e36926c-e6c5-49f7-a607-9f56a4bbb73b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:05:01.130113225Z\",\n \"endTime\": \"2026-03-18T22:06:29.307118365Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to verify existence of managed resource group 'patch-name-99xb7j--managed': ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerErro...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: MultipleErrorsOccurred; detail code InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.R...full failure pattern: ERROR CODE: MultipleErrorsOccurred; detail code InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 1 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
<*fmt.wrapError | 0xc00133a3c0>:
failed to create HCP cluster disabled-image-registry-hcp-cluster: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-sv2zcp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: MultipleErrorsOccurred
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e",
"name": "b06360bf-0a54-4e7d-b9f1-3e5b6626253e",
"status": "Failed",
"startTime": "2026-03-18T22:17:00.823479898Z",
"endTime": "2026-03-18T22:18:09.152905722Z",
"error": {
"code": "MultipleErrorsOccurred",
"message": "Cluster provisioning failed due to multiple errors",
"details": [
{
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
},
{
"code": "InternalServerError",
"message": "Failed to get virtual network 'customer-vnet-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "failed to get managed identity '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-120/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress': ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "failed to get network security group 'customer-nsg-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-sv2zcp\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"name\": \"b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:17:00.823479898Z\",\n \"endTime\": \"2026-03-18T22:18:09.152905722Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to get virtual network 'customer-vnet-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to get managed identity '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-120/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress': ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to get network security group 'customer-nsg-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00133a3a0>{
msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-sv2zcp\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"name\": \"b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:17:00.823479898Z\",\n \"endTime\": \"2026-03-18T22:18:09.152905722Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to get virtual network 'customer-vnet-name' details: Cl...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
<*fmt.wrapError | 0xc00133a3c0>:
failed to create HCP cluster disabled-image-registry-hcp-cluster: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-sv2zcp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: MultipleErrorsOccurred
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e",
"name": "b06360bf-0a54-4e7d-b9f1-3e5b6626253e",
"status": "Failed",
"startTime": "2026-03-18T22:17:00.823479898Z",
"endTime": "2026-03-18T22:18:09.152905722Z",
"error": {
"code": "MultipleErrorsOccurred",
"message": "Cluster provisioning failed due to multiple errors",
"details": [
{
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
},
{
"code": "InternalServerError",
"message": "Failed to get virtual network 'customer-vnet-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "failed to get managed identity '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-120/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress': ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "failed to get network security group 'customer-nsg-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
},
{
"code": "InternalServerError",
"message": "ClientCertificateCredential: unable to resolve an endpoint: server response error:\n context deadline exceeded"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-sv2zcp\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"name\": \"b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:17:00.823479898Z\",\n \"endTime\": \"2026-03-18T22:18:09.152905722Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to get virtual network 'customer-vnet-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to get managed identity '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-prod-120/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress': ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to get network security group 'customer-nsg-name' details: ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"ClientCertificateCredential: unable to resolve an endpoint: server response error:\\n context deadline exceeded\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00133a3a0>{
msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-sv2zcp\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"name\": \"b06360bf-0a54-4e7d-b9f1-3e5b6626253e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-18T22:17:00.823479898Z\",\n \"endTime\": \"2026-03-18T22:18:09.152905722Z\",\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"Cluster provisioning failed due to multiple errors\",\n \"details\": [\n {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n },\n {\n \"code\": \"InternalServerError\",\n \"message\": \"Failed to get virtual network 'customer-vnet-name' details: Cl...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-6d7nnsfull failure pattern: found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-6d7nns Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 1 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0016cd758>:
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-6d7nns
{
errs: [
<*errors.errorString | 0xc000502840>{
s: "found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-6d7nns",
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0016cd758>:
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-6d7nns
{
errs: [
<*errors.errorString | 0xc000502840>{
s: "found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-6d7nns",
},
],
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-dgq99rfull failure pattern: found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-dgq99r Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 1 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0012c3e30>:
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-dgq99r
{
errs: [
<*errors.errorString | 0xc0017cdab0>{
s: "found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-dgq99r",
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0012c3e30>:
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-dgq99r
{
errs: [
<*errors.errorString | 0xc0017cdab0>{
s: "found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-dgq99r",
},
],
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-whz9b5full failure pattern: found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-whz9b5 Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 1 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc001a1ebd0>:
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-whz9b5
{
errs: [
<*errors.errorString | 0xc001598330>{
s: "found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-whz9b5",
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc001a1ebd0>:
found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-whz9b5
{
errs: [
<*errors.errorString | 0xc001598330>{
s: "found 1 managed resource groups left behind HCP clusters in rg-cluster-nsg-subnet-reuse-whz9b5",
},
],
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
not to be emptyfull failure pattern: not to be empty Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 0 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 1 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:126]: Expected
<[]*armredhatopenshifthcp.ImageDigestMirror | len:0, cap:0>: nil
not to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:126]: Expected
<[]*armredhatopenshifthcp.ImageDigestMirror | len:0, cap:0>: nil
not to be emptyContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
subscription openshift-nfd/nfd not ready, state="" (OLM still processing, no errors detected)full failure pattern: subscription openshift-nfd/nfd not ready, state="" (OLM still processing, no errors detected) Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.56%1 of 39 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 15: 0 · Mar 16: 1 · Mar 17: 0 · Mar 18: 0 · Mar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:60]: Timed out after 600.007s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc001039e40>:
subscription openshift-nfd/nfd not ready, state="" (OLM still processing, no errors detected)
{
s: "subscription openshift-nfd/nfd not ready, state=\"\" (OLM still processing, no errors detected)",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:60]: Timed out after 600.007s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc001039e40>:
subscription openshift-nfd/nfd not ready, state="" (OLM still processing, no errors detected)
{
s: "subscription openshift-nfd/nfd not ready, state=\"\" (OLM still processing, no errors detected)",
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||