No failure patterns match your search.
Environment: PROD
Failure patterns: 7 · Failures matched: 61 · Total runs: 6 · Runs affected: 6
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | e2e | 6 | 100.00%6 of 6 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | Show trend detailsApr 1: 0 · Apr 2: 18 · Apr 3: 6 · Apr 4: 0 · Apr 5: 3 · Apr 6: 1 · Apr 7: 16 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)04/07/26 05:38:04.367
STEP: attempting to update nodepool version to higher than cluster version @ 04/07/26 05:48:19.896
"ts"="2026-04-07 05:48:20.460472" "msg"="invalid node pool version update" "error"="PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-l57kvq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Invalid value: \\\"4.21.0\\\": invalid node pool version 4.21.0: cannot exceed control plane version 4.20.16\",\n \"target\": \"properties.version.id\"\n }\n}\n--------------------------------------------------------------------------------\n"
STEP: attempting to update immutable platform profile fields @ 04/07/26 05:48:20.46
"ts"="2026-04-07 05:48:21.151220" "msg"="updating immutable fields" "error"="PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-l57kvq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"4 errors occurred\",\n \"details\": [\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform\"\n },\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform.vmSize\"\n },\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform.osDisk\"\n },\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform.availabilityZone\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"
"ts"="2026-04-07 05:48:21.271777" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-04-07 05:48:21.271880" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-negative-tests-cluster-rv6wgd" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 05:48:21.346235" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-negative-tests-cluster-rv6wgd" "resourceGroup"=""
"ts"="2026-04-07 05:48:22.942477" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-92ac8e02d20de6cf37d354d7e01d22da1b3bf7e3835a3ed2f6f6742a237a853f.yaml.gz"
"ts"="2026-04-07 05:48:22.942620" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-92ac8e02d20de6cf37d354d7e01d22da1b3bf7e3835a3ed2f6f6742a237a853f.yaml.gz"
"ts"="2026-04-07 05:48:22.942678" "level"=0 "msg"="collecting debug info"
"ts"="2026-04-07 05:48:22.944144" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-13"
"ts"="2026-04-07 05:48:22.944161" "level"=0 "msg"="collecting deployments" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 05:48:23.204714" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-negative-tests-l57kvq" "deployment"="pooledNonMsiScopedAssignments-oeayaalhj7wjy"
"ts"="2026-04-07 05:48:23.305309" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-negative-tests-l57kvq" "deployment"="customer-infra-negative-tests-cluster-rv6wgd"
"ts"="2026-04-07 05:48:23.320326" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-13" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-04-07 05:48:23.825441" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-13" "deployment"="msi-deployment-13"
"ts"="2026-04-07 05:48:24.341336" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-04-07 05:48:24.341454" "level"=0 "msg"="deleting created resources"
"ts"="2026-04-07 05:48:24.341626" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 06:07:46.163294" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 06:07:46.163320" "level"=0 "msg"="deleting resource group" "resourceGroup"="rg-negative-tests-l57kvq"
Command Error: signal: killed
Deserializaion Error: no output from command
04/07/26 05:38:04.367
STEP: attempting to update nodepool version to higher than cluster version @ 04/07/26 05:48:19.896
"ts"="2026-04-07 05:48:20.460472" "msg"="invalid node pool version update" "error"="PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-l57kvq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Invalid value: \\\"4.21.0\\\": invalid node pool version 4.21.0: cannot exceed control plane version 4.20.16\",\n \"target\": \"properties.version.id\"\n }\n}\n--------------------------------------------------------------------------------\n"
STEP: attempting to update immutable platform profile fields @ 04/07/26 05:48:20.46
"ts"="2026-04-07 05:48:21.151220" "msg"="updating immutable fields" "error"="PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-l57kvq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: MultipleErrorsOccurred\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"MultipleErrorsOccurred\",\n \"message\": \"4 errors occurred\",\n \"details\": [\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform\"\n },\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform.vmSize\"\n },\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform.osDisk\"\n },\n {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Forbidden: field is immutable\",\n \"target\": \"properties.platform.availabilityZone\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"
"ts"="2026-04-07 05:48:21.271777" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-04-07 05:48:21.271880" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-negative-tests-cluster-rv6wgd" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 05:48:21.346235" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-negative-tests-cluster-rv6wgd" "resourceGroup"=""
"ts"="2026-04-07 05:48:22.942477" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-92ac8e02d20de6cf37d354d7e01d22da1b3bf7e3835a3ed2f6f6742a237a853f.yaml.gz"
"ts"="2026-04-07 05:48:22.942620" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-92ac8e02d20de6cf37d354d7e01d22da1b3bf7e3835a3ed2f6f6742a237a853f.yaml.gz"
"ts"="2026-04-07 05:48:22.942678" "level"=0 "msg"="collecting debug info"
"ts"="2026-04-07 05:48:22.944144" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-13"
"ts"="2026-04-07 05:48:22.944161" "level"=0 "msg"="collecting deployments" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 05:48:23.204714" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-negative-tests-l57kvq" "deployment"="pooledNonMsiScopedAssignments-oeayaalhj7wjy"
"ts"="2026-04-07 05:48:23.305309" "level"=0 "msg"="collecting operations" "resourceGroup"="rg-negative-tests-l57kvq" "deployment"="customer-infra-negative-tests-cluster-rv6wgd"
"ts"="2026-04-07 05:48:23.320326" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-13" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-04-07 05:48:23.825441" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-13" "deployment"="msi-deployment-13"
"ts"="2026-04-07 05:48:24.341336" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-04-07 05:48:24.341454" "level"=0 "msg"="deleting created resources"
"ts"="2026-04-07 05:48:24.341626" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 06:07:46.163294" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="rg-negative-tests-l57kvq"
"ts"="2026-04-07 06:07:46.163320" "level"=0 "msg"="deleting resource group" "resourceGroup"="rg-negative-tests-l57kvq"
Command Error: signal: killed
Deserializaion Error: no output from commandRunning Suite: - /opt/app-root/src/github.com/Azure/ARO-HCP
============================================================
Random Seed: 1775539371 - will randomize all specs
Will run 1 of 1 specs
------------------------------
Customer should upgrade a nodepool from 4.20.z to 4.21.zLatest [PreLaunchSetup:None, Importance:Critical, Positivity:Positive, ARO-HCP-RP-API-Compatible]
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:231
STEP: creating resource group @ 04/07/26 05:23:00.777
"ts"="2026-04-07 05:23:00.777205" "level"=0 "msg"="creating resource group" "resourceGroup"="rg-np-version-upgrade-9c578f-xr8n8x"
STEP: creating cluster parameters at control plane version @ 04/07/26 05:23:04.384
STEP: creating customer resources @ 04/07/26 05:23:04.465
STEP: creating the HCP cluster with version 4.21.7 @ 04/07/26 05:23:51.414
"ts"="2026-04-07 05:23:51.414251" "level"=0 "msg"="Starting HCP cluster creation" "clusterName"="np-version-upgrade-cluster-9c578f" "resourceGroup"="rg-np-version-upgrade-9c578f-xr8n8x"
STEP: creating nodepool with version 4.20.17 (behind control plane; upgrade path validated via Cincinnati) @ 04/07/26 05:34:55.888
STEP: getting admin credentials and lowest control plane version from OpenShift version history @ 04/07/26 05:45:52.841
STEP: computing nodepool desired version from Cincinnati (lowest <= lowest control plane version with upgrade path from nodepool) @ 04/07/26 05:48:21.331
STEP: capturing node release images before upgrade @ 04/07/26 05:48:21.463
STEP: triggering nodepool upgrade to version 4.21.7 @ 04/07/26 05:48:21.503
STEP: verifying nodes are ready, updated to expected version, and release images differ from pre-upgrade @ 04/07/26 05:49:13.715
Command Error: signal: killed
Deserializaion Error: no output from command
Running Suite: - /opt/app-root/src/github.com/Azure/ARO-HCP
============================================================
Random Seed: 1775539371 - will randomize all specs
Will run 1 of 1 specs
------------------------------
Customer should upgrade a nodepool from 4.20.z to 4.21.zLatest [PreLaunchSetup:None, Importance:Critical, Positivity:Positive, ARO-HCP-RP-API-Compatible]
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:231
STEP: creating resource group @ 04/07/26 05:23:00.777
"ts"="2026-04-07 05:23:00.777205" "level"=0 "msg"="creating resource group" "resourceGroup"="rg-np-version-upgrade-9c578f-xr8n8x"
STEP: creating cluster parameters at control plane version @ 04/07/26 05:23:04.384
STEP: creating customer resources @ 04/07/26 05:23:04.465
STEP: creating the HCP cluster with version 4.21.7 @ 04/07/26 05:23:51.414
"ts"="2026-04-07 05:23:51.414251" "level"=0 "msg"="Starting HCP cluster creation" "clusterName"="np-version-upgrade-cluster-9c578f" "resourceGroup"="rg-np-version-upgrade-9c578f-xr8n8x"
STEP: creating nodepool with version 4.20.17 (behind control plane; upgrade path validated via Cincinnati) @ 04/07/26 05:34:55.888
STEP: getting admin credentials and lowest control plane version from OpenShift version history @ 04/07/26 05:45:52.841
STEP: computing nodepool desired version from Cincinnati (lowest <= lowest control plane version with upgrade path from nodepool) @ 04/07/26 05:48:21.331
STEP: capturing node release images before upgrade @ 04/07/26 05:48:21.463
STEP: triggering nodepool upgrade to version 4.21.7 @ 04/07/26 05:48:21.503
STEP: verifying nodes are ready, updated to expected version, and release images differ from pre-upgrade @ 04/07/26 05:49:13.715
Command Error: signal: killed
Deserializaion Error: no output from commandRunning Suite: - /opt/app-root/src/github.com/Azure/ARO-HCP
============================================================
Random Seed: 1775539380 - will randomize all specs
Will run 1 of 1 specs
------------------------------
Customer should upgrade a nodepool from 4.21.z to 4.21.zLatest [PreLaunchSetup:None, Importance:Critical, Positivity:Positive, ARO-HCP-RP-API-Compatible]
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:234
STEP: creating resource group @ 04/07/26 05:23:01.232
"ts"="2026-04-07 05:23:01.232866" "level"=0 "msg"="creating resource group" "resourceGroup"="rg-np-version-upgrade-tczjgc-tp2rpx"
STEP: creating cluster parameters at control plane version @ 04/07/26 05:23:05.133
STEP: creating customer resources @ 04/07/26 05:23:05.225
STEP: creating the HCP cluster with version 4.21.7 @ 04/07/26 05:23:50.322
"ts"="2026-04-07 05:23:50.322296" "level"=0 "msg"="Starting HCP cluster creation" "clusterName"="np-version-upgrade-cluster-tczjgc" "resourceGroup"="rg-np-version-upgrade-tczjgc-tp2rpx"
STEP: creating nodepool with version 4.21.5 (behind control plane; upgrade path validated via Cincinnati) @ 04/07/26 05:34:54.824
Command Error: signal: killed
Deserializaion Error: no output from command
Running Suite: - /opt/app-root/src/github.com/Azure/ARO-HCP
============================================================
Random Seed: 1775539380 - will randomize all specs
Will run 1 of 1 specs
------------------------------
Customer should upgrade a nodepool from 4.21.z to 4.21.zLatest [PreLaunchSetup:None, Importance:Critical, Positivity:Positive, ARO-HCP-RP-API-Compatible]
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:234
STEP: creating resource group @ 04/07/26 05:23:01.232
"ts"="2026-04-07 05:23:01.232866" "level"=0 "msg"="creating resource group" "resourceGroup"="rg-np-version-upgrade-tczjgc-tp2rpx"
STEP: creating cluster parameters at control plane version @ 04/07/26 05:23:05.133
STEP: creating customer resources @ 04/07/26 05:23:05.225
STEP: creating the HCP cluster with version 4.21.7 @ 04/07/26 05:23:50.322
"ts"="2026-04-07 05:23:50.322296" "level"=0 "msg"="Starting HCP cluster creation" "clusterName"="np-version-upgrade-cluster-tczjgc" "resourceGroup"="rg-np-version-upgrade-tczjgc-tp2rpx"
STEP: creating nodepool with version 4.21.5 (behind control plane; upgrade path validated via Cincinnati) @ 04/07/26 05:34:54.824
Command Error: signal: killed
Deserializaion Error: no output from commandContributing tests (8)
Affected runs (6)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Process did not finish before 2h0m0s timeoutfull failure pattern: Process did not finish before 2h0m0s timeout Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days | unknown | 5 | 83.33%5 of 6 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days | Show trend detailsApr 1: 0 · Apr 2: 2 · Apr 3: 2 · Apr 4: 0 · Apr 5: 1 · Apr 6: 1 · Apr 7: 5 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3){"component":"entrypoint","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:169","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2026-04-07T06:08:14Z"}{"component":"entrypoint","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:169","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2026-04-07T06:07:36Z"}{"component":"entrypoint","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:169","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.ExecuteProcess","level":"error","msg":"Process did not finish before 2h0m0s timeout","severity":"error","time":"2026-04-07T06:07:00Z"}Contributing tests (1)
Affected runs (5)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | e2e | 4 | 66.67%4 of 6 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | Show trend detailsApr 1: 0 · Apr 2: 18 · Apr 3: 8 · Apr 4: 0 · Apr 5: 9 · Apr 6: 7 · Apr 7: 9 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:44]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:44]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:45]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:45]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:51]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:51]: Interrupted by User Contributing tests (8)
Affected runs (4)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster credsfull failure pattern: timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | e2e | 2 | 33.33%2 of 6 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | Show trend detailsApr 1: 0 · Apr 2: 0 · Apr 3: 0 · Apr 4: 0 · Apr 5: 0 · Apr 6: 0 · Apr 7: 14 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
<*fmt.wrapErrors | 0xc00152e090>:
failed waiting for hcpCluster="admin-cred-lifecycle-w2k2l9" in resourcegroup="admin-credential-lifecycle-test-xnk8kd" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-w2k2l9 in resource group admin-credential-lifecycle-test-xnk8kd, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-w2k2l9\" in resourcegroup=\"admin-credential-lifecycle-test-xnk8kd\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-w2k2l9 in resource group admin-credential-lifecycle-test-xnk8kd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000dd89c0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-w2k2l9 in resource group admin-credential-lifecycle-test-xnk8kd",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
<*fmt.wrapErrors | 0xc00152e090>:
failed waiting for hcpCluster="admin-cred-lifecycle-w2k2l9" in resourcegroup="admin-credential-lifecycle-test-xnk8kd" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-w2k2l9 in resource group admin-credential-lifecycle-test-xnk8kd, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-w2k2l9\" in resourcegroup=\"admin-credential-lifecycle-test-xnk8kd\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-w2k2l9 in resource group admin-credential-lifecycle-test-xnk8kd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000dd89c0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-w2k2l9 in resource group admin-credential-lifecycle-test-xnk8kd",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:125]: Unexpected error:
<*fmt.wrapErrors | 0xc0012d06c0>:
failed waiting for hcpCluster="cluster-stable-4-20-5875bd" in resourcegroup="rg-stable-4-20-sx464q" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-stable-4-20-5875bd in resource group rg-stable-4-20-sx464q, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cluster-stable-4-20-5875bd\" in resourcegroup=\"rg-stable-4-20-sx464q\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-stable-4-20-5875bd in resource group rg-stable-4-20-sx464q, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001362380>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-stable-4-20-5875bd in resource group rg-stable-4-20-sx464q",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:125]: Unexpected error:
<*fmt.wrapErrors | 0xc0012d06c0>:
failed waiting for hcpCluster="cluster-stable-4-20-5875bd" in resourcegroup="rg-stable-4-20-sx464q" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-stable-4-20-5875bd in resource group rg-stable-4-20-sx464q, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cluster-stable-4-20-5875bd\" in resourcegroup=\"rg-stable-4-20-sx464q\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-stable-4-20-5875bd in resource group rg-stable-4-20-sx464q, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001362380>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-stable-4-20-5875bd in resource group rg-stable-4-20-sx464q",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapErrors | 0xc0014db050>:
failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-bqjn7p" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-bqjn7p, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-bqjn7p\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-bqjn7p, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000614870>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-bqjn7p",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapErrors | 0xc0014db050>:
failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-bqjn7p" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-bqjn7p, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-bqjn7p\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-bqjn7p, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000614870>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-bqjn7p",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (10)
Affected runs (2)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 2 | 33.33%2 of 6 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsApr 1: 0 · Apr 2: 0 · Apr 3: 0 · Apr 4: 0 · Apr 5: 0 · Apr 6: 0 · Apr 7: 6 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:154]: Unexpected error:
<*fmt.wrapErrors | 0xc000958690>:
failed to create NodePool npupgrade-4-21, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-21 in resource group rg-np-version-upgrade-pmp787-kwgkwl, error: failed waiting for nodepool="npupgrade-4-21" for cluster "np-version-upgrade-cluster-pmp787" in resourcegroup="rg-np-version-upgrade-pmp787-kwgkwl" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool npupgrade-4-21, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-21 in resource group rg-np-version-upgrade-pmp787-kwgkwl, error: failed waiting for nodepool=\"npupgrade-4-21\" for cluster \"np-version-upgrade-cluster-pmp787\" in resourcegroup=\"rg-np-version-upgrade-pmp787-kwgkwl\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001248460>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-21 in resource group rg-np-version-upgrade-pmp787-kwgkwl",
},
<*fmt.wrapError | 0xc001104340>{
msg: "failed waiting for nodepool=\"npupgrade-4-21\" for cluster \"np-version-upgrade-cluster-pmp787\" in resourcegroup=\"rg-np-version-upgrade-pmp787-kwgkwl\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:154]: Unexpected error:
<*fmt.wrapErrors | 0xc000958690>:
failed to create NodePool npupgrade-4-21, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-21 in resource group rg-np-version-upgrade-pmp787-kwgkwl, error: failed waiting for nodepool="npupgrade-4-21" for cluster "np-version-upgrade-cluster-pmp787" in resourcegroup="rg-np-version-upgrade-pmp787-kwgkwl" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool npupgrade-4-21, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-21 in resource group rg-np-version-upgrade-pmp787-kwgkwl, error: failed waiting for nodepool=\"npupgrade-4-21\" for cluster \"np-version-upgrade-cluster-pmp787\" in resourcegroup=\"rg-np-version-upgrade-pmp787-kwgkwl\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001248460>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npupgrade-4-21 in resource group rg-np-version-upgrade-pmp787-kwgkwl",
},
<*fmt.wrapError | 0xc001104340>{
msg: "failed waiting for nodepool=\"npupgrade-4-21\" for cluster \"np-version-upgrade-cluster-pmp787\" in resourcegroup=\"rg-np-version-upgrade-pmp787-kwgkwl\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc0012d86f0>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-b8kv4h, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-b8kv4h" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-b8kv4h, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-b8kv4h\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001247440>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-b8kv4h",
},
<*fmt.wrapError | 0xc0005187e0>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-b8kv4h\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc0012d86f0>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-b8kv4h, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-b8kv4h" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-b8kv4h, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-b8kv4h\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001247440>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-b8kv4h",
},
<*fmt.wrapError | 0xc0005187e0>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-b8kv4h\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
<*fmt.wrapErrors | 0xc001604390>:
failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-nszsx5, error: failed waiting for nodepool="nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-nszsx5" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-nszsx5, error: failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-nszsx5\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0009757d0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-nszsx5",
},
<*fmt.wrapError | 0xc000e161a0>{
msg: "failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-nszsx5\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
<*fmt.wrapErrors | 0xc001604390>:
failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-nszsx5, error: failed waiting for nodepool="nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-nszsx5" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-nszsx5, error: failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-nszsx5\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0009757d0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-nszsx5",
},
<*fmt.wrapError | 0xc000e161a0>{
msg: "failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-nszsx5\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredContributing tests (6)
Affected runs (2)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s) | e2e | 1 | 16.67%1 of 6 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s) | Show trend detailsApr 1: 0 · Apr 2: 0 · Apr 3: 0 · Apr 4: 0 · Apr 5: 0 · Apr 6: 0 · Apr 7: 10 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:108]: Unexpected error:
<*fmt.wrapErrors | 0xc001193290>:
failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-879vc5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-879vc5, error: context deadline exceeded
{
msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-879vc5\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-879vc5, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001180090>{
s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-879vc5",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:108]: Unexpected error:
<*fmt.wrapErrors | 0xc001193290>:
failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-879vc5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-879vc5, error: context deadline exceeded
{
msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-879vc5\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-879vc5, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001180090>{
s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-879vc5",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
<*fmt.wrapErrors | 0xc0014d1560>:
failed to create HCP cluster cluster-zstream-4-20-s2sjhd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: failed waiting for cluster="cluster-zstream-4-20-s2sjhd" in resourcegroup="rg-zstream-upgrade-4-20-tjt8qk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: context deadline exceeded
{
msg: "failed to create HCP cluster cluster-zstream-4-20-s2sjhd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: failed waiting for cluster=\"cluster-zstream-4-20-s2sjhd\" in resourcegroup=\"rg-zstream-upgrade-4-20-tjt8qk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013b6770>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk",
},
<*fmt.wrapErrors | 0xc0014d1530>{
msg: "failed waiting for cluster=\"cluster-zstream-4-20-s2sjhd\" in resourcegroup=\"rg-zstream-upgrade-4-20-tjt8qk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013b6770>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:141]: Unexpected error:
<*fmt.wrapErrors | 0xc0014d1560>:
failed to create HCP cluster cluster-zstream-4-20-s2sjhd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: failed waiting for cluster="cluster-zstream-4-20-s2sjhd" in resourcegroup="rg-zstream-upgrade-4-20-tjt8qk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: context deadline exceeded
{
msg: "failed to create HCP cluster cluster-zstream-4-20-s2sjhd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: failed waiting for cluster=\"cluster-zstream-4-20-s2sjhd\" in resourcegroup=\"rg-zstream-upgrade-4-20-tjt8qk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013b6770>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk",
},
<*fmt.wrapErrors | 0xc0014d1530>{
msg: "failed waiting for cluster=\"cluster-zstream-4-20-s2sjhd\" in resourcegroup=\"rg-zstream-upgrade-4-20-tjt8qk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013b6770>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-s2sjhd in resource group rg-zstream-upgrade-4-20-tjt8qk",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc0008d4210>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-jwszks" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-jwszks\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e02710>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks",
},
<*fmt.wrapErrors | 0xc0008d41e0>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-jwszks\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e02710>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc0008d4210>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-jwszks" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-jwszks\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e02710>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks",
},
<*fmt.wrapErrors | 0xc0008d41e0>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-jwszks\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e02710>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-jwszks",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (10)
Affected runs (1)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 5 day(s) | e2e | 1 | 16.67%1 of 6 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 5 day(s) | Show trend detailsApr 1: 0 · Apr 2: 7 · Apr 3: 7 · Apr 4: 0 · Apr 5: 3 · Apr 6: 1 · Apr 7: 1 | none | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:181]: Unexpected error:
<*fmt.wrapError | 0xc000f2c9e0>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-ztlcvl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 500: 500 Internal Server Error
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"error": {
"code": "InternalServerError",
"message": "Internal server error."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-ztlcvl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"Internal server error.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00178b8c0>{
ErrorCode: "InternalServerError",
StatusCode: 500,
RawResponse: {
Status: "500 Internal Server Error",
StatusCode: 500,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"9df649c9-418f-4940-bec8-8c0e548e3db3",
],
"X-Content-Type-Options": ["nosniff"],
"Expires": ["-1"],
"Date": [
"Tue, 07 Apr 2026 05:20:56 GMT",
],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": [
"InternalServerError",
],
"X-Ms-Request-Id": [
"b0981fa0-473c-423b-8940-929e8b4ed066",
],
"X-Envoy-Upstream-Service-Time": ["1246"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"WESTEUROPE:20260407T052056Z:9df649c9-418f-4940-bec8-8c0e548e3db3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["107"],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/westeurope/95c613cd-bdd4-496d-928d-a3fc6f2b736e",
],
"X-Msedge-Ref": [
"Ref A: 9189BB39768F4C5AA7879357F88C2139 Ref B: CHI261140501031 Ref C: 2026-04-07T05:20:55Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000f2c920>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 107,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "m...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:181]: Unexpected error:
<*fmt.wrapError | 0xc000f2c9e0>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-ztlcvl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 500: 500 Internal Server Error
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"error": {
"code": "InternalServerError",
"message": "Internal server error."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-ztlcvl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"Internal server error.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00178b8c0>{
ErrorCode: "InternalServerError",
StatusCode: 500,
RawResponse: {
Status: "500 Internal Server Error",
StatusCode: 500,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"9df649c9-418f-4940-bec8-8c0e548e3db3",
],
"X-Content-Type-Options": ["nosniff"],
"Expires": ["-1"],
"Date": [
"Tue, 07 Apr 2026 05:20:56 GMT",
],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": [
"InternalServerError",
],
"X-Ms-Request-Id": [
"b0981fa0-473c-423b-8940-929e8b4ed066",
],
"X-Envoy-Upstream-Service-Time": ["1246"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"WESTEUROPE:20260407T052056Z:9df649c9-418f-4940-bec8-8c0e548e3db3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["107"],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/westeurope/95c613cd-bdd4-496d-928d-a3fc6f2b736e",
],
"X-Msedge-Ref": [
"Ref A: 9189BB39768F4C5AA7879357F88C2139 Ref B: CHI261140501031 Ref C: 2026-04-07T05:20:55Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000f2c920>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 107,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "m...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||