Executive Status
EnvEnvironment partition: dev, int, stg, or prod. | GoalConfigured success target and run scope for this environment. INT/STG/PROD use all E2E job runs. DEV uses post-good runs plus Tide batches: runs on the final commit of a PR that later merged, or batch retests of PRs that passed their individual e2e-parallel checks. | RunsNumber of job runs in the selected goal definition for this environment. | SuccessSuccess rate on the selected goal definition: (runs - failed runs) / runs * 100. | Gap vs targetDifference in percentage points between current success and the configured target rate. | Change vs prevHow much the success rate changed compared with the immediately preceding equal-length window, using the same goal definition as this row. | Provision successProvisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step. DEV rows use post-good runs plus Tide batches. INT/STG/PROD show n/a because provisioning is not part of those environments. | Provision change vs prevChange in provision success, in percentage points, compared with the previous equal-length window. Uses the same provision-success definition as the Provision success column. DEV only; INT/STG/PROD show n/a. | E2E successAmong runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step. DEV rows use only runs after the final push to a PR that later merged. INT/STG/PROD use all E2E job runs. | E2E success vs prevChange in E2E success, in percentage points, compared with the previous equal-length window. Uses the same E2E-success definition as the E2E success column. |
|---|---|---|---|---|---|---|---|---|---|
| DEV | 95% - Post-good runs + Tide batches | 381 | 66.93% (off track) | -28.07pp | +9.12pp | 77.47% (282/364) | +1.94pp | 90.43% (255/282) | +12.26pp |
| INT | 95% - All E2E job runs | 77 | 37.66% (off track) | -57.34pp | -21.16pp | n/a | n/a | 38.67% (29/75) | -20.16pp |
| STG | 95% - All E2E job runs | 36 | 52.78% (off track) | -42.22pp | -47.22pp | n/a | n/a | 55.88% (19/34) | -44.12pp |
| PROD | 95% - All E2E job runs | 64 | 59.38% (off track) | -35.62pp | +26.04pp | n/a | n/a | 61.29% (38/62) | +27.96pp |
Environment: DEV
E2E Jobs
729
Success Rate
52.95%
Provision success
Provisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step.73.22% (473/646)
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.81.61% (386/473)
E2E Jobs (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. This card shows the number of runs in that DEV-only goal basis.381
Success Rate (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. This card shows the overall success rate for that DEV-only goal basis.66.93%
Provision success (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. Provisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step.77.47% (282/364)
E2E success (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.90.43% (255/282)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
Daily Run Outcomes for DEV Goal Basis (post-good + batches)
Successful runs (post-good + batches)
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 90.00% | 80 | rp-api-compat-all/parallel | Customer should be able to use workload identity via the cluster OIDC issuer URL |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.Authorizationfull failure pattern: ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.Authorization Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | provision | 92 | 12.62%92 of 729 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | Show trend detailsMar 2: 22 · Mar 3: 21 · Mar 4: 35 · Mar 5: 14 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)time=2026-03-05T18:59:54.847Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-03-05T18:59:56.517Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-03-05T18:59:57.630Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=829db07553358e04ba6f1974ce4382138f4ed683bf2846b0fd1f28bcc23e2098
time=2026-03-05T19:01:58.722Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j6003968/providers/Microsoft.Resources/deployments/829db07553358e04ba6f1974ce4382138f4ed683bf2846b0fd1f28bcc23e2098/operationStatuses/08584288696885440870\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j6003968/providers/Microsoft.Resources/deployments/svc-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j6003968/providers/Microsoft.Monitor/accounts/services-j6003968/providers/Microsoft.Authorization/roleAssignments/b92119a1-893c-5d44-8e94-8017dcd14434\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T190018Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f8034c64-29df-4a64-a87d-1e6b3d8a13de', request correlation id 'a537b1c5-5960-4794-9504-fdb91cfb0c64'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"time=2026-03-05T15:56:11.735Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-03-05T15:56:13.671Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-03-05T15:56:14.913Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=ed84426758cbbb353371a9235a496758b8f3e98aa625c265db09a4e3e29cda2c
time=2026-03-05T15:58:15.933Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j7455488/providers/Microsoft.Resources/deployments/ed84426758cbbb353371a9235a496758b8f3e98aa625c265db09a4e3e29cda2c/operationStatuses/08584288807112291690\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Resources/deployments/hcp-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Monitor/accounts/hcps-j7455488/providers/Microsoft.Authorization/roleAssignments/caa896f1-1d74-5c65-824e-d46f9b44719f\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T155635Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '6e38dbe3-68e4-4adb-b4dc-72161e062672', request correlation id '1056ad0c-dd70-4639-a07e-4effd484f439'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n },\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Resources/deployments/svc-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Monitor/accounts/services-j7455488/providers/Microsoft.Authorization/roleAssignments/fb67040b-742c-5416-bfc1-eb6a3205318d\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T155628Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '83a7fc85-9a1f-4ce7-a764-3f5342de9960', request correlation id '1056ad0c-dd70-4639-a07e-4effd484f439'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"time=2026-03-05T15:54:30.586Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-03-05T15:54:32.976Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-03-05T15:54:34.248Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=a89c2c923545ab2245aae3e95f8c1e0e15fd41c82d7aa26d45863bc410cd51f2
time=2026-03-05T15:56:35.445Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j4296704/providers/Microsoft.Resources/deployments/a89c2c923545ab2245aae3e95f8c1e0e15fd41c82d7aa26d45863bc410cd51f2/operationStatuses/08584288808119232283\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j4296704/providers/Microsoft.Resources/deployments/svc-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j4296704/providers/Microsoft.Monitor/accounts/services-j4296704/providers/Microsoft.Authorization/roleAssignments/f804a3aa-59ee-5d3f-8e21-9cd520cda0fb\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T155449Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'a38e6fcf-aa35-42d4-ba05-70159e9be81c', request correlation id 'a8ffd35f-99a4-4c58-952a-d6ac85d98793'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"Contributing tests (1)
Affected runs (92) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 8 days | e2e | 10 | 1.37%10 of 729 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 8 days | Show trend detailsMar 2: 30 · Mar 3: 12 · Mar 4: 16 · Mar 5: 12 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 4 · Mar 11: 3 · Mar 12: 1 · Mar 13: 7 · Mar 14: 0 · Mar 15: 0 | INT, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapErrors | 0xc00173f4d0>:
failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-wj68jn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: context deadline exceeded
{
msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wj68jn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e03920>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn",
},
<*fmt.wrapErrors | 0xc00173f4a0>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wj68jn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e03920>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapErrors | 0xc00173f4d0>:
failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-wj68jn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: context deadline exceeded
{
msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wj68jn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e03920>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn",
},
<*fmt.wrapErrors | 0xc00173f4a0>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wj68jn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e03920>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wj68jn",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc000a345d0>:
failed to create HCP cluster list-test-cluster-fg7g2l, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: failed waiting for cluster="list-test-cluster-fg7g2l" in resourcegroup="cluster-listing-nc7jbv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-fg7g2l, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: failed waiting for cluster=\"list-test-cluster-fg7g2l\" in resourcegroup=\"cluster-listing-nc7jbv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea76a0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv",
},
<*fmt.wrapErrors | 0xc000a345a0>{
msg: "failed waiting for cluster=\"list-test-cluster-fg7g2l\" in resourcegroup=\"cluster-listing-nc7jbv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea76a0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc000a345d0>:
failed to create HCP cluster list-test-cluster-fg7g2l, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: failed waiting for cluster="list-test-cluster-fg7g2l" in resourcegroup="cluster-listing-nc7jbv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-fg7g2l, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: failed waiting for cluster=\"list-test-cluster-fg7g2l\" in resourcegroup=\"cluster-listing-nc7jbv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea76a0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv",
},
<*fmt.wrapErrors | 0xc000a345a0>{
msg: "failed waiting for cluster=\"list-test-cluster-fg7g2l\" in resourcegroup=\"cluster-listing-nc7jbv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea76a0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-fg7g2l in resource group cluster-listing-nc7jbv",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc000a3ac30>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-4pgbh8" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-4pgbh8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001224c50>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8",
},
<*fmt.wrapErrors | 0xc000a3ac00>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-4pgbh8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001224c50>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc000a3ac30>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-4pgbh8" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-4pgbh8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001224c50>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8",
},
<*fmt.wrapErrors | 0xc000a3ac00>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-4pgbh8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001224c50>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-4pgbh8",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (18)
Affected runs (10) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not foundfull failure pattern: failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 9 | 1.23%9 of 729 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 3 · Mar 3: 6 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000e283c0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b30960>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000e283c0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b30960>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc00090f2a0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000c660a0>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc00090f2a0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000c660a0>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000587040>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b62780>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000587040>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b62780>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurredContributing tests (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 8 | 1.10%8 of 729 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 3 · Mar 7: 0 · Mar 8: 0 · Mar 9: 1 · Mar 10: 5 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc0012ab180>:
failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000fafb60>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Tue, 10 Mar 2026 19:34:29 GMT",
],
"Content-Length": ["316"],
"X-Envoy-Upstream-Service-Time": ["25"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"f582fe12-33f9-4c9a-95d4-c934cb1441c8",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0012ab0a0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 118, 114, 106, 99, 122, 52, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 316,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j3677056.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredenti...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc0012ab180>:
failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000fafb60>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Tue, 10 Mar 2026 19:34:29 GMT",
],
"Content-Length": ["316"],
"X-Envoy-Upstream-Service-Time": ["25"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"f582fe12-33f9-4c9a-95d4-c934cb1441c8",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0012ab0a0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 118, 114, 106, 99, 122, 52, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 316,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j3677056.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-vrjcz4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredenti...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:105]: Unexpected error:
<*fmt.wrapError | 0xc000a02c20>:
failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f47e60>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"82c53113-ce1b-4dd4-bd27-dd5b5ee92864",
],
"Date": [
"Tue, 10 Mar 2026 19:34:24 GMT",
],
"Content-Length": ["346"],
"X-Envoy-Upstream-Service-Time": ["27"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0xc000a02a80>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 100, 105, 115, 97, 98, 108, 101, 100, 45, 105, 109, 97, 103, 101, 45, 114, 101, 103, 105, 115, 116, 114, 121, 45, 122, 98, 116, 50, 109, 108, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 100, 105, 115, 97, 98, 108, 101, 100, 45, 105, 109, 97, 103, 101, 45, 114, 101, 103, 105, 115, 116, 114, 121, 45, 104, 99, 112, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 346,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j3677056.hcpsvc.osadev.cloud",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:105]: Unexpected error:
<*fmt.wrapError | 0xc000a02c20>:
failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j3677056.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-zbt2ml/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f47e60>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"82c53113-ce1b-4dd4-bd27-dd5b5ee92864",
],
"Date": [
"Tue, 10 Mar 2026 19:34:24 GMT",
],
"Content-Length": ["346"],
"X-Envoy-Upstream-Service-Time": ["27"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0xc000a02a80>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 100, 105, 115, 97, 98, 108, 101, 100, 45, 105, 109, 97, 103, 101, 45, 114, 101, 103, 105, 115, 116, 114, 121, 45, 122, 98, 116, 50, 109, 108, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 100, 105, 115, 97, 98, 108, 101, 100, 45, 105, 109, 97, 103, 101, 45, 114, 101, 103, 105, 115, 116, 114, 121, 45, 104, 99, 112, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 346,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j3677056.hcpsvc.osadev.cloud",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:173]: Unexpected error:
<*fmt.wrapError | 0xc00141e7a0>:
failed to start credential request: POST https://rp.j1986688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j1986688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008b7830>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"032dd7ef-e3c7-4688-a613-f8a1b5d25b8e",
],
"Date": [
"Tue, 10 Mar 2026 15:57:48 GMT",
],
"Content-Length": ["346"],
"X-Envoy-Upstream-Service-Time": ["1028"],
},
Body: <*exported.nopClosingBytesReader | 0xc00141e6a0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 97, 100, 109, 105, 110, 45, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 45, 108, 105, 102, 101, 99, 121, 99, 108, 101, 45, 116, 101, 115, 116, 45, 104, 120, 106, 107, 56, 109, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 97, 100, 109, 105, 110, 45, 99, 114, 101, 100, 45, 108, 105, 102, 101, 99, 121, 99, 108, 101, 45, 116, 57, 53, 54, 104, 102, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 346,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1986688.hcpsvc.osadev.cloud",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:173]: Unexpected error:
<*fmt.wrapError | 0xc00141e7a0>:
failed to start credential request: POST https://rp.j1986688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j1986688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hxjk8m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-t956hf\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008b7830>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"032dd7ef-e3c7-4688-a613-f8a1b5d25b8e",
],
"Date": [
"Tue, 10 Mar 2026 15:57:48 GMT",
],
"Content-Length": ["346"],
"X-Envoy-Upstream-Service-Time": ["1028"],
},
Body: <*exported.nopClosingBytesReader | 0xc00141e6a0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 97, 100, 109, 105, 110, 45, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 45, 108, 105, 102, 101, 99, 121, 99, 108, 101, 45, 116, 101, 115, 116, 45, 104, 120, 106, 107, 56, 109, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 97, 100, 109, 105, 110, 45, 99, 114, 101, 100, 45, 108, 105, 102, 101, 99, 121, 99, 108, 101, 45, 116, 57, 53, 54, 104, 102, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 346,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1986688.hcpsvc.osadev.cloud",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (6)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Yet, Eventually failed because the matcher was not satisfied:full failure pattern: Yet, Eventually failed because the matcher was not satisfied: Signal: IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | e2e | 8 | 1.10%8 of 729 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 5 · Mar 13: 2 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:314]: Told to stop trying after 20.278s.
Pod failed; see logs for details
At one point, however, the function did return successfully.
Yet, Eventually failed because the matcher was not satisfied:
Expected
<v1.PodPhase>: Running
to equal
<v1.PodPhase>: Succeeded
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:314]: Told to stop trying after 20.278s.
Pod failed; see logs for details
At one point, however, the function did return successfully.
Yet, Eventually failed because the matcher was not satisfied:
Expected
<v1.PodPhase>: Running
to equal
<v1.PodPhase>: Succeededfail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:314]: Told to stop trying after 20.276s.
Pod failed; see logs for details
At one point, however, the function did return successfully.
Yet, Eventually failed because the matcher was not satisfied:
Expected
<v1.PodPhase>: Running
to equal
<v1.PodPhase>: Succeeded
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:314]: Told to stop trying after 20.276s.
Pod failed; see logs for details
At one point, however, the function did return successfully.
Yet, Eventually failed because the matcher was not satisfied:
Expected
<v1.PodPhase>: Running
to equal
<v1.PodPhase>: Succeededfail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:314]: Told to stop trying after 20.250s.
Pod failed; see logs for details
At one point, however, the function did return successfully.
Yet, Eventually failed because the matcher was not satisfied:
Expected
<v1.PodPhase>: Pending
to equal
<v1.PodPhase>: Succeeded
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:314]: Told to stop trying after 20.250s.
Pod failed; see logs for details
At one point, however, the function did return successfully.
Yet, Eventually failed because the matcher was not satisfied:
Expected
<v1.PodPhase>: Pending
to equal
<v1.PodPhase>: SucceededContributing tests (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Environment: INT
E2E Jobs
77
Success Rate
37.66%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.38.67% (29/75)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 75.56% | 45 | integration/parallel | Authorized CIDRs Connectivity should allow API access only from authorized VM IP | |
| 77.78% | 45 | integration/parallel | Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle | |
| 86.67% | 15 | integration/parallel | Control plane automated z-stream upgrade with candidate channel should perform an automated control plane z-stream upgrade using the candidate channel | |
| 91.11% | 45 | integration/parallel | Customer should be able to create a cluster with an external auth config and get the external auth config | |
| 91.11% | 45 | integration/parallel | Customer should create an HCP cluster and validate TLS certificates |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days | e2e | 9 | 11.69%9 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days | Show trend detailsMar 2: 14 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 16 · Mar 8: 42 · Mar 9: 1 · Mar 10: 0 · Mar 11: 1 · Mar 12: 1 · Mar 13: 0 · Mar 14: 1 · Mar 15: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc0009aed80>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-ccshfw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-ccshfw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f45af0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw",
},
<*fmt.wrapErrors | 0xc0009aed50>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-ccshfw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f45af0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc0009aed80>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-ccshfw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-ccshfw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f45af0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw",
},
<*fmt.wrapErrors | 0xc0009aed50>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-ccshfw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f45af0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-ccshfw",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc00032e8d0>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-zkjhtw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-zkjhtw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014f4be0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw",
},
<*fmt.wrapErrors | 0xc00032e8a0>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-zkjhtw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014f4be0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapErrors | 0xc00032e8d0>:
failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-zkjhtw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: context deadline exceeded
{
msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-zkjhtw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014f4be0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw",
},
<*fmt.wrapErrors | 0xc00032e8a0>{
msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-zkjhtw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014f4be0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-zkjhtw",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc0010ea060>:
failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster="list-test-cluster-ccxwqz" in resourcegroup="cluster-listing-d94s94" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a83a70>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
},
<*fmt.wrapErrors | 0xc0010ea030>{
msg: "failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a83a70>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc0010ea060>:
failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster="list-test-cluster-ccxwqz" in resourcegroup="cluster-listing-d94s94" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a83a70>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
},
<*fmt.wrapErrors | 0xc0010ea030>{
msg: "failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a83a70>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (18)
Affected runs (9)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | e2e | 5 | 6.49%5 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | Show trend detailsMar 2: 5 · Mar 3: 0 · Mar 4: 11 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [:0]: Interrupted by User fail [:0]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:120]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:120]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:46]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:46]: Interrupted by User Contributing tests (12)
Affected runs (5)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed waiting for deployment "aro-hcp-demo" in resourcegroup="<resource-group>" to finish: context deadline exceededfull failure pattern: failed waiting for deployment "aro-hcp-demo" in resourcegroup="<resource-group>" to finish: context deadline exceeded Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | e2e | 5 | 6.49%5 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | Show trend detailsMar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 1 · Mar 8: 3 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc00130a2e0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-2v2fc9" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-2v2fc9\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc00130a2e0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-2v2fc9" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-2v2fc9\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000e301a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-r9kx6m" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-r9kx6m\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000e301a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-r9kx6m" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-r9kx6m\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000efa380>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-m27vw4" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-m27vw4\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000efa380>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-m27vw4" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-m27vw4\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredContributing tests (1)
Affected runs (5)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: c...full failure pattern: failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled Signal: IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | e2e | 5 | 6.49%5 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 2 · Mar 13: 3 · Mar 14: 0 · Mar 15: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc001620390>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-vl49pp" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc00080bde0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-vl49pp\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00080bdc0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-vl49pp\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00080bda0>{
msg: "failed waiting for hcpCluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-vl49pp\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc001620390>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-vl49pp" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc00080bde0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-vl49pp\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00080bdc0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-vl49pp\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00080bda0>{
msg: "failed waiting for hcpCluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-vl49pp\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000d462a0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-kvlw4b" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc0008ff140>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kvlw4b\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0008ff120>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kvlw4b\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0008ff100>{
msg: "failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kvlw4b\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000d462a0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-kvlw4b" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc0008ff140>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kvlw4b\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0008ff120>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kvlw4b\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0008ff100>{
msg: "failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kvlw4b\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000a38c90>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="list-test-cluster-2fj9s5" in resourcegroup="cluster-listing-hdwkfd" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc0007639e0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-2fj9s5\" in resourcegroup=\"cluster-listing-hdwkfd\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0007636c0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-2fj9s5\" in resourcegroup=\"cluster-listing-hdwkfd\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000763560>{
msg: "failed waiting for hcpCluster=\"list-test-cluster-2fj9s5\" in resourcegroup=\"cluster-listing-hdwkfd\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000a38c90>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="list-test-cluster-2fj9s5" in resourcegroup="cluster-listing-hdwkfd" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc0007639e0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-2fj9s5\" in resourcegroup=\"cluster-listing-hdwkfd\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0007636c0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-2fj9s5\" in resourcegroup=\"cluster-listing-hdwkfd\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000763560>{
msg: "failed waiting for hcpCluster=\"list-test-cluster-2fj9s5\" in resourcegroup=\"cluster-listing-hdwkfd\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredContributing tests (6)
Affected runs (5)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
RevokeCredentialsAndWait timed out after <minutes> minutes; context deadline exceededfull failure pattern: RevokeCredentialsAndWait timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 5 | 6.49%5 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 2 · Mar 15: 3 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:193]: Unexpected error:
<*fmt.wrapErrors | 0xc0010d0990>:
failed waiting for hcpCluster="admin-cred-lifecycle-pq72j7" in resourcegroup="admin-credential-lifecycle-test-h2qqpf" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-pq72j7 in resource group admin-credential-lifecycle-test-h2qqpf, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-pq72j7\" in resourcegroup=\"admin-credential-lifecycle-test-h2qqpf\" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-pq72j7 in resource group admin-credential-lifecycle-test-h2qqpf, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ba21f0>{
s: "timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-pq72j7 in resource group admin-credential-lifecycle-test-h2qqpf",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:193]: Unexpected error:
<*fmt.wrapErrors | 0xc0010d0990>:
failed waiting for hcpCluster="admin-cred-lifecycle-pq72j7" in resourcegroup="admin-credential-lifecycle-test-h2qqpf" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-pq72j7 in resource group admin-credential-lifecycle-test-h2qqpf, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-pq72j7\" in resourcegroup=\"admin-credential-lifecycle-test-h2qqpf\" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-pq72j7 in resource group admin-credential-lifecycle-test-h2qqpf, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ba21f0>{
s: "timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-pq72j7 in resource group admin-credential-lifecycle-test-h2qqpf",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:193]: Unexpected error:
<*fmt.wrapErrors | 0xc0015288d0>:
failed waiting for hcpCluster="admin-cred-lifecycle-xxmzq6" in resourcegroup="admin-credential-lifecycle-test-gb2rdr" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-xxmzq6 in resource group admin-credential-lifecycle-test-gb2rdr, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-xxmzq6\" in resourcegroup=\"admin-credential-lifecycle-test-gb2rdr\" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-xxmzq6 in resource group admin-credential-lifecycle-test-gb2rdr, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000037e40>{
s: "timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-xxmzq6 in resource group admin-credential-lifecycle-test-gb2rdr",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:193]: Unexpected error:
<*fmt.wrapErrors | 0xc0015288d0>:
failed waiting for hcpCluster="admin-cred-lifecycle-xxmzq6" in resourcegroup="admin-credential-lifecycle-test-gb2rdr" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-xxmzq6 in resource group admin-credential-lifecycle-test-gb2rdr, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-xxmzq6\" in resourcegroup=\"admin-credential-lifecycle-test-gb2rdr\" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-xxmzq6 in resource group admin-credential-lifecycle-test-gb2rdr, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000037e40>{
s: "timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-xxmzq6 in resource group admin-credential-lifecycle-test-gb2rdr",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:193]: Unexpected error:
<*fmt.wrapErrors | 0xc001148150>:
failed waiting for hcpCluster="admin-cred-lifecycle-7z8gkd" in resourcegroup="admin-credential-lifecycle-test-mf5bt8" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-7z8gkd in resource group admin-credential-lifecycle-test-mf5bt8, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-7z8gkd\" in resourcegroup=\"admin-credential-lifecycle-test-mf5bt8\" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-7z8gkd in resource group admin-credential-lifecycle-test-mf5bt8, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00050faa0>{
s: "timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-7z8gkd in resource group admin-credential-lifecycle-test-mf5bt8",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:193]: Unexpected error:
<*fmt.wrapErrors | 0xc001148150>:
failed waiting for hcpCluster="admin-cred-lifecycle-7z8gkd" in resourcegroup="admin-credential-lifecycle-test-mf5bt8" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-7z8gkd in resource group admin-credential-lifecycle-test-mf5bt8, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-7z8gkd\" in resourcegroup=\"admin-credential-lifecycle-test-mf5bt8\" to finish revoking creds, caused by: timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-7z8gkd in resource group admin-credential-lifecycle-test-mf5bt8, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00050faa0>{
s: "timeout '15.000000' minutes exceeded during RevokeCredentialsAndWait for cluster admin-cred-lifecycle-7z8gkd in resource group admin-credential-lifecycle-test-mf5bt8",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (1)
Affected runs (5)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: NoiseSignal: Noise — source deserialization/no-output error | e2e | 4 | 5.19%4 of 77 job runs affected | NoiseSignal: Noise — source deserialization/no-output error | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 3 · Mar 8: 14 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)ess report:
Customer should be able to create a cluster with an external auth config and get the external auth config (Spec Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
In [It] (Node Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
At [By Step] creating the HCP cluster (Step Runtime: 23m7.947s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:86
Spec Goroutine
goroutine 83 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000e984b0}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000e984b0}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0007184d0?}, {{0x8229828?, 0xc000f8ec00?}, 0xc0014a10f0?}, 0xc000095460, {0xc001686080, 0x1c}, {0x77f1061, 0xa}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fe87c4e9260, 0xc000e0a900})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:87
|
| By("creating the HCP cluster")
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e0a900?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 80
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93 @ 03/09/26 00:55:48.983
"ts"="2026-03-09 00:55:48.983513" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:48.983579" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-ea-cluster-lhqv9g" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:49.269384" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-ea-cluster-lhqv9g" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.373231" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373342" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373399" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.374388" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-93"
"ts"="2026-03-09 00:55:50.374406" "level"=0 "msg"="collecting deployments" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:50.548442" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="pooledNonMsiScopedAssignments-ltdphft7fgrwg"
"ts"="2026-03-09 00:55:50.625278" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.704199" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="customer-infra-ea-cluster-lhqv9g"
"ts"="2026-03-09 00:55:50.773364" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="msi-deployment-93"
"ts"="2026-03-09 00:55:50.914401" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:50.914511" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:50.914617" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="external-auth-cluster-mzjzr2"
Command Error: signal: killed
Deserializaion Error: no output from command
ess report:
Customer should be able to create a cluster with an external auth config and get the external auth config (Spec Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
In [It] (Node Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
At [By Step] creating the HCP cluster (Step Runtime: 23m7.947s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:86
Spec Goroutine
goroutine 83 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000e984b0}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000e984b0}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0007184d0?}, {{0x8229828?, 0xc000f8ec00?}, 0xc0014a10f0?}, 0xc000095460, {0xc001686080, 0x1c}, {0x77f1061, 0xa}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fe87c4e9260, 0xc000e0a900})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:87
|
| By("creating the HCP cluster")
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e0a900?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 80
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93 @ 03/09/26 00:55:48.983
"ts"="2026-03-09 00:55:48.983513" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:48.983579" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-ea-cluster-lhqv9g" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:49.269384" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-ea-cluster-lhqv9g" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.373231" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373342" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373399" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.374388" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-93"
"ts"="2026-03-09 00:55:50.374406" "level"=0 "msg"="collecting deployments" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:50.548442" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="pooledNonMsiScopedAssignments-ltdphft7fgrwg"
"ts"="2026-03-09 00:55:50.625278" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.704199" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="customer-infra-ea-cluster-lhqv9g"
"ts"="2026-03-09 00:55:50.773364" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="msi-deployment-93"
"ts"="2026-03-09 00:55:50.914401" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:50.914511" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:50.914617" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="external-auth-cluster-mzjzr2"
Command Error: signal: killed
Deserializaion Error: no output from command/ARO-HCP/test/e2e/cluster_list_no_infra.go:79
Spec Goroutine
goroutine 76 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000c06a00}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000c06a00}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0014ae5b0?}, {{0x8229828?, 0xc000f10400?}, 0xc001315150?}, 0xc0000954d8, {0xc0017180c0, 0x16}, {0xc001718108, 0x18}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func9.1({0x7fc3e407da20, 0xc000e9a4b0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:80
|
| By("creating HCP cluster: " + clusterName)
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e9a4b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 105
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86 @ 03/09/26 00:55:49.002
"ts"="2026-03-09 00:55:49.002403" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.002460" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:49.170511" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.720443" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720526" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720575" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.721543" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-35"
"ts"="2026-03-09 00:55:50.721556" "level"=0 "msg"="collecting deployments" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:50.721574" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-68"
"ts"="2026-03-09 00:55:50.869107" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="pooledNonMsiScopedAssignments-uiliqvnffsucw"
"ts"="2026-03-09 00:55:50.889358" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.015471" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.094004" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="msi-deployment-68"
"ts"="2026-03-09 00:55:51.164853" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="msi-deployment-35"
"ts"="2026-03-09 00:55:51.208118" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw"
"ts"="2026-03-09 00:55:51.362721" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.362834" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.362929" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="cluster-listing-tvdjtg"
Command Error: signal: killed
Deserializaion Error: no output from command
/ARO-HCP/test/e2e/cluster_list_no_infra.go:79
Spec Goroutine
goroutine 76 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000c06a00}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000c06a00}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0014ae5b0?}, {{0x8229828?, 0xc000f10400?}, 0xc001315150?}, 0xc0000954d8, {0xc0017180c0, 0x16}, {0xc001718108, 0x18}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func9.1({0x7fc3e407da20, 0xc000e9a4b0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:80
|
| By("creating HCP cluster: " + clusterName)
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e9a4b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 105
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86 @ 03/09/26 00:55:49.002
"ts"="2026-03-09 00:55:49.002403" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.002460" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:49.170511" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.720443" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720526" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720575" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.721543" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-35"
"ts"="2026-03-09 00:55:50.721556" "level"=0 "msg"="collecting deployments" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:50.721574" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-68"
"ts"="2026-03-09 00:55:50.869107" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="pooledNonMsiScopedAssignments-uiliqvnffsucw"
"ts"="2026-03-09 00:55:50.889358" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.015471" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.094004" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="msi-deployment-68"
"ts"="2026-03-09 00:55:51.164853" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="msi-deployment-35"
"ts"="2026-03-09 00:55:51.208118" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw"
"ts"="2026-03-09 00:55:51.362721" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.362834" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.362929" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="cluster-listing-tvdjtg"
Command Error: signal: killed
Deserializaion Error: no output from commandc/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
In [It] (Node Runtime: 1h29m59.889s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
At [By Step] creating the hcp cluster with the image registry disabled (Step Runtime: 23m8.709s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:81
Spec Goroutine
goroutine 96 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc00097e820}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc00097e820}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc00087e8c0?}, {{0x8229828?, 0xc00004b200?}, 0xc00168c378?}, 0xc0000957c8, {0xc0016a0480, 0x1e}, {0x786b387, 0x23}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func20.2({0x7ff1b027fa60, 0xc000c2c8d0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:82
|
| By("creating the hcp cluster with the image registry disabled")
> err = tc.CreateHCPClusterFromParam(
| ctx,
| GinkgoLogr,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000c2c8d0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 93
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89 @ 03/09/26 00:55:49.008
"ts"="2026-03-09 00:55:49.008288" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.008364" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:49.343675" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.681031" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681136" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681197" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.682147" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-17"
"ts"="2026-03-09 00:55:50.682158" "level"=0 "msg"="collecting deployments" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:50.829842" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="pooledNonMsiScopedAssignments-qmh74zogaodhg"
"ts"="2026-03-09 00:55:50.849482" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.963939" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg"
"ts"="2026-03-09 00:55:51.014912" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="msi-deployment-17"
"ts"="2026-03-09 00:55:51.157334" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.157426" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.157531" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="disabled-image-registry-l274nt"
Command Error: signal: killed
Deserializaion Error: no output from command
c/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
In [It] (Node Runtime: 1h29m59.889s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
At [By Step] creating the hcp cluster with the image registry disabled (Step Runtime: 23m8.709s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:81
Spec Goroutine
goroutine 96 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc00097e820}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc00097e820}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc00087e8c0?}, {{0x8229828?, 0xc00004b200?}, 0xc00168c378?}, 0xc0000957c8, {0xc0016a0480, 0x1e}, {0x786b387, 0x23}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func20.2({0x7ff1b027fa60, 0xc000c2c8d0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:82
|
| By("creating the hcp cluster with the image registry disabled")
> err = tc.CreateHCPClusterFromParam(
| ctx,
| GinkgoLogr,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000c2c8d0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 93
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89 @ 03/09/26 00:55:49.008
"ts"="2026-03-09 00:55:49.008288" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.008364" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:49.343675" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.681031" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681136" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681197" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.682147" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-17"
"ts"="2026-03-09 00:55:50.682158" "level"=0 "msg"="collecting deployments" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:50.829842" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="pooledNonMsiScopedAssignments-qmh74zogaodhg"
"ts"="2026-03-09 00:55:50.849482" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.963939" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg"
"ts"="2026-03-09 00:55:51.014912" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="msi-deployment-17"
"ts"="2026-03-09 00:55:51.157334" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.157426" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.157531" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="disabled-image-registry-l274nt"
Command Error: signal: killed
Deserializaion Error: no output from commandContributing tests (11)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | e2e | 4 | 5.19%4 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 1 · Mar 8: 3 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InvalidIdentityValues; provider Microsoft.ManagedIdentityfull failure pattern: ERROR CODE: InvalidIdentityValues; provider Microsoft.ManagedIdentity Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 4 | 5.19%4 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 4 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
<*exported.ResponseError | 0xc000f97890>:
PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-zpzk8c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidIdentityValues
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidIdentityValues",
"message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InvalidIdentityValues",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T151231Z:9c11778c-ff60-487b-a423-651593da8efe",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 4505E2BF16A0421FA071A149B08EF585 Ref B: CHI261140504060 Ref C: 2026-03-11T15:12:31Z",
],
"Cache-Control": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Failure-Cause": ["gateway"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 11 Mar 2026 15:12:31 GMT",
],
"Pragma": ["no-cache"],
"Content-Length": ["1927"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"9c11778c-ff60-487b-a423-651593da8efe",
],
"X-Ms-Correlation-Request-Id": [
"9c11778c-ff60-487b-a423-651593da8efe",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001100fc0>{
s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
i: 0,
},
ContentLength: 1927,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/64f0619f-ebc2-4156-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
<*exported.ResponseError | 0xc000f97890>:
PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-zpzk8c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidIdentityValues
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidIdentityValues",
"message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InvalidIdentityValues",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T151231Z:9c11778c-ff60-487b-a423-651593da8efe",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 4505E2BF16A0421FA071A149B08EF585 Ref B: CHI261140504060 Ref C: 2026-03-11T15:12:31Z",
],
"Cache-Control": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Failure-Cause": ["gateway"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 11 Mar 2026 15:12:31 GMT",
],
"Pragma": ["no-cache"],
"Content-Length": ["1927"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"9c11778c-ff60-487b-a423-651593da8efe",
],
"X-Ms-Correlation-Request-Id": [
"9c11778c-ff60-487b-a423-651593da8efe",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001100fc0>{
s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
i: 0,
},
ContentLength: 1927,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/64f0619f-ebc2-4156-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
<*exported.ResponseError | 0xc0009bd380>:
PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nld688/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidIdentityValues
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidIdentityValues",
"message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InvalidIdentityValues",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T130855Z:1f5ad0e5-72af-4f34-87a3-cbd696db9711",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["1937"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Request-Id": [
"1f5ad0e5-72af-4f34-87a3-cbd696db9711",
],
"X-Ms-Correlation-Request-Id": [
"1f5ad0e5-72af-4f34-87a3-cbd696db9711",
],
"X-Msedge-Ref": [
"Ref A: 79888FDC7E984BA8A98CF39D24F6722A Ref B: CH1AA2020610011 Ref C: 2026-03-11T13:08:55Z",
],
"Date": [
"Wed, 11 Mar 2026 13:08:54 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d91100>{
s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
i: 0,
},
ContentLength: 1937,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/64f0619f-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
<*exported.ResponseError | 0xc0009bd380>:
PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nld688/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidIdentityValues
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidIdentityValues",
"message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InvalidIdentityValues",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T130855Z:1f5ad0e5-72af-4f34-87a3-cbd696db9711",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["1937"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Request-Id": [
"1f5ad0e5-72af-4f34-87a3-cbd696db9711",
],
"X-Ms-Correlation-Request-Id": [
"1f5ad0e5-72af-4f34-87a3-cbd696db9711",
],
"X-Msedge-Ref": [
"Ref A: 79888FDC7E984BA8A98CF39D24F6722A Ref B: CH1AA2020610011 Ref C: 2026-03-11T13:08:55Z",
],
"Date": [
"Wed, 11 Mar 2026 13:08:54 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d91100>{
s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
i: 0,
},
ContentLength: 1937,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/64f0619f-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
<*exported.ResponseError | 0xc00087cb10>:
PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-q89nkn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidIdentityValues
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidIdentityValues",
"message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InvalidIdentityValues",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Request-Id": [
"5d0f1a83-e9e3-4322-9402-079527a36e43",
],
"X-Ms-Correlation-Request-Id": [
"5d0f1a83-e9e3-4322-9402-079527a36e43",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 7799C63EF4DB4BDE88CFAD7F106271DB Ref B: CHI261140512040 Ref C: 2026-03-11T06:03:42Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["1947"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T060342Z:5d0f1a83-e9e3-4322-9402-079527a36e43",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 11 Mar 2026 06:03:41 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00011d160>{
s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
i: 0,
},
ContentLength: 1947,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
<*exported.ResponseError | 0xc00087cb10>:
PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-q89nkn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidIdentityValues
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidIdentityValues",
"message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InvalidIdentityValues",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Request-Id": [
"5d0f1a83-e9e3-4322-9402-079527a36e43",
],
"X-Ms-Correlation-Request-Id": [
"5d0f1a83-e9e3-4322-9402-079527a36e43",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 7799C63EF4DB4BDE88CFAD7F106271DB Ref B: CHI261140512040 Ref C: 2026-03-11T06:03:42Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["1947"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T060342Z:5d0f1a83-e9e3-4322-9402-079527a36e43",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 11 Mar 2026 06:03:41 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00011d160>{
s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
i: 0,
},
ContentLength: 1947,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Test Panickedfull failure pattern: Test Panicked Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 55 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000f66b90?, {0x7fc7e6d7b600?, 0xc0006e6d80?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0004f3320, {0x7fc7e6d7b600, 0xc0006e6d80}, {0xc000f586f0, 0x17}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func20.1({0x7fc7e6d7b600, 0xc0006e6d80})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:74 +0x20a
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc0006e6d80?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 110
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000f66b90?, {0x7fc7e6d7b600?, 0xc0006e6d80?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0004f3320, {0x7fc7e6d7b600, 0xc0006e6d80}, {0xc000f586f0, 0x17}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func20.1({0x7fc7e6d7b600, 0xc0006e6d80})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:74 +0x20a
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc0006e6d80?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 110
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000088910?, {0x7fdcdc31ce00?, 0xc000ac8210?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000860b40, {0x7fdcdc31ce00, 0xc000ac8210}, {0x783a7e5, 0x1b}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func11.1({0x7fdcdc31ce00, 0xc000ac8210})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:49 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ac8210?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 92
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000088910?, {0x7fdcdc31ce00?, 0xc000ac8210?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000860b40, {0x7fdcdc31ce00, 0xc000ac8210}, {0x783a7e5, 0x1b}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func11.1({0x7fdcdc31ce00, 0xc000ac8210})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:49 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ac8210?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 92
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c7c6c0?, {0x7fd105635138?, 0xc00096cae0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0009970e0, {0x7fd105635138, 0xc00096cae0}, {0x77f67a9, 0xd}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fd105635138, 0xc00096cae0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:59 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc00096cae0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 75
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c7c6c0?, {0x7fd105635138?, 0xc00096cae0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0009970e0, {0x7fd105635138, 0xc00096cae0}, {0x77f67a9, 0xd}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fd105635138, 0xc00096cae0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:59 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc00096cae0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 75
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test PanickedContributing tests (22)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
not to be nilfull failure pattern: not to be nil Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 5 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:91]: Expected
<*string | 0x0>: nil
not to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:91]: Expected
<*string | 0x0>: nil
not to be nilfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:145]: Expected
<*string | 0x0>: nil
not to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:145]: Expected
<*string | 0x0>: nil
not to be nilContributing tests (2)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 1 · Mar 11: 0 · Mar 12: 3 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapError | 0xc00038c420>:
failed creating external auth "ea-list" in resourcegroup="ea-list-9lhb8x" for cluster="ea-listgv59sm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-9lhb8x/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listgv59sm/externalAuths/ea-list
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating external auth \"ea-list\" in resourcegroup=\"ea-list-9lhb8x\" for cluster=\"ea-listgv59sm\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-9lhb8x/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listgv59sm/externalAuths/ea-list\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00076e300>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Retry-After": ["10"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/4616b9c4-eae5-42c0-b42e-e60136e4b27a",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 22:53:06 GMT",
],
"Content-Length": ["186"],
"X-Ms-Request-Id": [
"0daaf6b9-dea5-419a-a781-f5d3f0c88c48",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Expires": ["-1"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: DD91E82BD13A4C8F974F7F6335BA4D4F Ref B: CHI261140506025 Ref C: 2026-03-12T22:52:57Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["10007"],
"X-Ms-Correlation-Request-Id": [
"132f0482-3ab7-4255-98f8-45a73cf0c24c",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T225307Z:132f0482-3ab7-4255-98f8-45a73cf0c24c",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00038c200>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 52, 102, 48, 54, 49, 57, 102, 45, 101, 98, 99, 50, 45, 52, 49, 53, 54, 45, 57, 100, 57, 49, 45, 99, 52, 99, 55, 56, 49, 100, 101, 55, 101, 53, 52, 34, 10, 32, 32, 32, 32, 125, 10, 125]...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapError | 0xc00038c420>:
failed creating external auth "ea-list" in resourcegroup="ea-list-9lhb8x" for cluster="ea-listgv59sm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-9lhb8x/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listgv59sm/externalAuths/ea-list
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating external auth \"ea-list\" in resourcegroup=\"ea-list-9lhb8x\" for cluster=\"ea-listgv59sm\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-9lhb8x/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listgv59sm/externalAuths/ea-list\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00076e300>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Retry-After": ["10"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/4616b9c4-eae5-42c0-b42e-e60136e4b27a",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 22:53:06 GMT",
],
"Content-Length": ["186"],
"X-Ms-Request-Id": [
"0daaf6b9-dea5-419a-a781-f5d3f0c88c48",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Expires": ["-1"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: DD91E82BD13A4C8F974F7F6335BA4D4F Ref B: CHI261140506025 Ref C: 2026-03-12T22:52:57Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["10007"],
"X-Ms-Correlation-Request-Id": [
"132f0482-3ab7-4255-98f8-45a73cf0c24c",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T225307Z:132f0482-3ab7-4255-98f8-45a73cf0c24c",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00038c200>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 52, 102, 48, 54, 49, 57, 102, 45, 101, 98, 99, 50, 45, 52, 49, 53, 54, 45, 57, 100, 57, 49, 45, 99, 52, 99, 55, 56, 49, 100, 101, 55, 101, 53, 52, 34, 10, 32, 32, 32, 32, 125, 10, 125]...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapError | 0xc00148e400>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-h2fml7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h2fml7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h2fml7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h2fml7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00148e3e0>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h2fml7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h2fml7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000b78690>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Content-Length": ["186"],
"X-Ms-Error-Code": ["LockContention"],
"X-Envoy-Upstream-Service-Time": ["10025"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/ab289601-a1be-4eea-baec-7844c0a021f7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 22:53:06 GMT",
],
"Content-Type": ["application/json"],
"Retry-After": ["10"],
"X-Ms-Failure-Cause": ["service"],
"X-Msedge-Ref": [
"Ref A: 6E495E82722B47FAB217CA309B5EFC10 Ref B: CHI261140501060 Ref C: 2026-03-12T22:52:57Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Ms-Request-Id": [
"c86fd44b-9640-4399-b837-438b4fc03302",
],
"X-Ms-Correlation-Request-Id": [
"8be5b8ee-e739-4b49-a85a-b05296aaa904",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapError | 0xc00148e400>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-h2fml7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h2fml7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h2fml7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h2fml7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00148e3e0>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h2fml7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h2fml7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000b78690>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Content-Length": ["186"],
"X-Ms-Error-Code": ["LockContention"],
"X-Envoy-Upstream-Service-Time": ["10025"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/ab289601-a1be-4eea-baec-7844c0a021f7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 22:53:06 GMT",
],
"Content-Type": ["application/json"],
"Retry-After": ["10"],
"X-Ms-Failure-Cause": ["service"],
"X-Msedge-Ref": [
"Ref A: 6E495E82722B47FAB217CA309B5EFC10 Ref B: CHI261140501060 Ref C: 2026-03-12T22:52:57Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Ms-Request-Id": [
"c86fd44b-9640-4399-b837-438b4fc03302",
],
"X-Ms-Correlation-Request-Id": [
"8be5b8ee-e739-4b49-a85a-b05296aaa904",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0015420c0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-pqj6m6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc000840400>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-pqj6m6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008403e0>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-pqj6m6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0013a6450>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Length": ["186"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Request-Id": [
"57007d8e-6281-4f79-87e3-6b62771677b7",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Thu, 12 Mar 2026 20:29:07 GMT",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["10009"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/9a19b057-0917-4393-a2cf-ff9874abdb4b",
],
"X-Ms-Correlation-Request-Id": [
"cd3510ea-1cec-45db-8f3f-4cac3c6e7c36",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: DC15C07BB4844226852ED55513D0D6F1 Ref B: CHI261140507054 Re...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0015420c0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-pqj6m6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc000840400>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-pqj6m6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008403e0>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-pqj6m6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0013a6450>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Length": ["186"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Request-Id": [
"57007d8e-6281-4f79-87e3-6b62771677b7",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Thu, 12 Mar 2026 20:29:07 GMT",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["10009"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/9a19b057-0917-4393-a2cf-ff9874abdb4b",
],
"X-Ms-Correlation-Request-Id": [
"cd3510ea-1cec-45db-8f3f-4cac3c6e7c36",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: DC15C07BB4844226852ED55513D0D6F1 Ref B: CHI261140507054 Re...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (4)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot update resource while resource is "accepted"; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot update resource while resource is "accepted"; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | e2e | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 1 · Mar 8: 1 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0013e8940>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-vbmtkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e8920>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0016c6510>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sun, 08 Mar 2026 02:33:37 GMT",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"96724c91-c0e4-45b4-85cd-edbec338dc84",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/26e3b26d-2515-4027-886c-e494057f0caa",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CC330869501F4FC1B72C45CD3C435C82 Ref B: CHI261140514060 Ref C: 2026-03-08T02:33:37Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["309"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["158"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"281b815b-2dce-4835-ab24-b18fa3f86296",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0013e8940>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-vbmtkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e8920>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0016c6510>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sun, 08 Mar 2026 02:33:37 GMT",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"96724c91-c0e4-45b4-85cd-edbec338dc84",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/26e3b26d-2515-4027-886c-e494057f0caa",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CC330869501F4FC1B72C45CD3C435C82 Ref B: CHI261140514060 Ref C: 2026-03-08T02:33:37Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["309"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["158"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"281b815b-2dce-4835-ab24-b18fa3f86296",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0009c8220>:
failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="basic-cluster-lpnmcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009c8200>{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00125e7e0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Sat, 07 Mar 2026 00:17:12 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T001712Z:97607234-1d4e-40a3-b8e5-4aac73aa1e83",
],
"X-Msedge-Ref": [
"Ref A: 8E3A3DDB29E7437B8A99525E6E2E994C Ref B: CH1AA2020603053 Ref C: 2026-03-07T00:17:12Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["311"],
"X-Ms-Request-Id": [
"e1ecbf3e-3dc4-4bd6-b628-f10b7dfdb837",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a8f427fa-8c59-4633-83d9-4928d11132df",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"97607234-1d4e-40a3-b8e5-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0009c8220>:
failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="basic-cluster-lpnmcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009c8200>{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00125e7e0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Sat, 07 Mar 2026 00:17:12 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T001712Z:97607234-1d4e-40a3-b8e5-4aac73aa1e83",
],
"X-Msedge-Ref": [
"Ref A: 8E3A3DDB29E7437B8A99525E6E2E994C Ref B: CH1AA2020603053 Ref C: 2026-03-07T00:17:12Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["311"],
"X-Ms-Request-Id": [
"e1ecbf3e-3dc4-4bd6-b628-f10b7dfdb837",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a8f427fa-8c59-4633-83d9-4928d11132df",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"97607234-1d4e-40a3-b8e5-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:99]: Unexpected error:
<*fmt.wrapError | 0xc00093c1a0>:
failed starting cluster creation "admin-cred-lifecycle-gsq42m" in resourcegroup="admin-credential-lifecycle-test-d7rjkq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m"
}
}
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-gsq42m\" in resourcegroup=\"admin-credential-lifecycle-test-d7rjkq\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000a866f0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Correlation-Request-Id": [
"22f6b334-ae72-4d29-abdd-961655511c8b",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T082524Z:22f6b334-ae72-4d29-abdd-961655511c8b",
],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 7189061EF1484B199452D76B6C371785 Ref B: CHI261140504023 Ref C: 2026-03-06T08:25:23Z",
],
"Content-Length": ["339"],
"X-Ms-Request-Id": [
"7936c10a-841b-4aa1-a869-f3b795f66237",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 08:25:24 GMT",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["156"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/30d32c87-7762-49c3-a732-f7cc8a9c64b3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00093c000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 117, 112, 100, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 97, 99, 99, 101, 112, 116, 101, 100, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 52, 102, 48, 54, 49, 57, 102, 45, 101, 98, 99, 50, 45, 52, 49, 53, 54,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:99]: Unexpected error:
<*fmt.wrapError | 0xc00093c1a0>:
failed starting cluster creation "admin-cred-lifecycle-gsq42m" in resourcegroup="admin-credential-lifecycle-test-d7rjkq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m"
}
}
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-gsq42m\" in resourcegroup=\"admin-credential-lifecycle-test-d7rjkq\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000a866f0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Correlation-Request-Id": [
"22f6b334-ae72-4d29-abdd-961655511c8b",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T082524Z:22f6b334-ae72-4d29-abdd-961655511c8b",
],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 7189061EF1484B199452D76B6C371785 Ref B: CHI261140504023 Ref C: 2026-03-06T08:25:23Z",
],
"Content-Length": ["339"],
"X-Ms-Request-Id": [
"7936c10a-841b-4aa1-a869-f3b795f66237",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 08:25:24 GMT",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["156"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/30d32c87-7762-49c3-a732-f7cc8a9c64b3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00093c000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 117, 112, 100, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 97, 99, 99, 101, 112, 116, 101, 100, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 52, 102, 48, 54, 49, 57, 102, 45, 101, 98, 99, 50, 45, 52, 49, 53, 54,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (3)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster credsfull failure pattern: timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 1 · Mar 10: 0 · Mar 11: 0 · Mar 12: 2 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapErrors | 0xc00154e1e0>:
failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-hb8wm7" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-hb8wm7, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-hb8wm7\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-hb8wm7, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001533930>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-hb8wm7",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapErrors | 0xc00154e1e0>:
failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-hb8wm7" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-hb8wm7, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-hb8wm7\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-hb8wm7, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001533930>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-hb8wm7",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapErrors | 0xc001502510>:
failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-7rvs2t" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-7rvs2t, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-7rvs2t\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-7rvs2t, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000879850>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-7rvs2t",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapErrors | 0xc001502510>:
failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-7rvs2t" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-7rvs2t, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-7rvs2t\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-7rvs2t, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000879850>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-7rvs2t",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:173]: Unexpected error:
<*fmt.wrapErrors | 0xc00133e300>:
failed waiting for hcpCluster="admin-cred-lifecycle-htfxlh" in resourcegroup="admin-credential-lifecycle-test-qq776z" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-htfxlh in resource group admin-credential-lifecycle-test-qq776z, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-htfxlh\" in resourcegroup=\"admin-credential-lifecycle-test-qq776z\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-htfxlh in resource group admin-credential-lifecycle-test-qq776z, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00135d130>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-htfxlh in resource group admin-credential-lifecycle-test-qq776z",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:173]: Unexpected error:
<*fmt.wrapErrors | 0xc00133e300>:
failed waiting for hcpCluster="admin-cred-lifecycle-htfxlh" in resourcegroup="admin-credential-lifecycle-test-qq776z" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-htfxlh in resource group admin-credential-lifecycle-test-qq776z, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-htfxlh\" in resourcegroup=\"admin-credential-lifecycle-test-qq776z\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-htfxlh in resource group admin-credential-lifecycle-test-qq776z, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00135d130>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-htfxlh in resource group admin-credential-lifecycle-test-qq776z",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (3)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot create resource while parent resource is provisioning; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot create resource while parent resource is provisioning; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 · Mar 9: 1 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapError | 0xc0007b0fa0>:
failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-8h7xd7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-8h7xd7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0007b0f60>{
msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-8h7xd7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015e0990>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Msedge-Ref": [
"Ref A: 1A43493D763743078F50D58A7107C67A Ref B: CHI261140511036 Ref C: 2026-03-09T15:39:54Z",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Content-Length": ["348"],
"X-Ms-Request-Id": [
"b47e62cf-b184-4859-bc06-a546313b427d",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T153955Z:71f1c6be-0050-4562-ae53-b90c10721c0e",
],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["169"],
"X-Ms-Correlation-Request-Id": [
"71f1c6be-0050-4562-ae53-b90c10721c0e",
],
"Date": [
"Mon, 09 Mar 2026 15:39:54 GMT",
],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=64dc69e4-d083-49fc-9569-ebece...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapError | 0xc0007b0fa0>:
failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-8h7xd7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-8h7xd7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0007b0f60>{
msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-8h7xd7\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-8h7xd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015e0990>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Msedge-Ref": [
"Ref A: 1A43493D763743078F50D58A7107C67A Ref B: CHI261140511036 Ref C: 2026-03-09T15:39:54Z",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Content-Length": ["348"],
"X-Ms-Request-Id": [
"b47e62cf-b184-4859-bc06-a546313b427d",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T153955Z:71f1c6be-0050-4562-ae53-b90c10721c0e",
],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["169"],
"X-Ms-Correlation-Request-Id": [
"71f1c6be-0050-4562-ae53-b90c10721c0e",
],
"Date": [
"Mon, 09 Mar 2026 15:39:54 GMT",
],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=64dc69e4-d083-49fc-9569-ebece...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapError | 0xc000a811a0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-h5pkc2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a81180>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00085a570>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T005738Z:3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["340"],
"X-Ms-Request-Id": [
"1abae542-ac83-46cd-a1af-21a4bf486bf6",
],
"X-Envoy-Upstream-Service-Time": ["163"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
"X-Msedge-Ref": [
"Ref A: 20FBA6E3D9A14716BDDE02615466306D Ref B: CHI261140505042 Ref C: 2026-03-06T00:57:38Z",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 00:57:38 GMT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapError | 0xc000a811a0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-h5pkc2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a81180>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00085a570>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T005738Z:3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["340"],
"X-Ms-Request-Id": [
"1abae542-ac83-46cd-a1af-21a4bf486bf6",
],
"X-Envoy-Upstream-Service-Time": ["163"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
"X-Msedge-Ref": [
"Ref A: 20FBA6E3D9A14716BDDE02615466306D Ref B: CHI261140505042 Ref C: 2026-03-06T00:57:38Z",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 00:57:38 GMT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InvalidTemplate; detail message Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the ...full failure pattern: ERROR CODE: InvalidTemplate; detail message Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 2 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000848600>:
failed creating deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-zhtprd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-zhtprd/providers/Microsoft.Resources/deployments/aro-hcp-demo
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidTemplate
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidTemplate",
"message": "Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.",
"additionalInfo": [
{
"type": "TemplateViolation",
"info": {
"lineNumber": 0,
"linePosition": 0,
"path": ""
}
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-zhtprd\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-zhtprd/providers/Microsoft.Resources/deployments/aro-hcp-demo\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidTemplate\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidTemplate\",\n \"message\": \"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\n \"additionalInfo\": [\n {\n \"type\": \"TemplateViolation\",\n \"info\": {\n \"lineNumber\": 0,\n \"linePosition\": 0,\n \"path\": \"\"\n }\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00135a990>{
ErrorCode: "InvalidTemplate",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Request-Id": [
"f4d69cdb-d05b-44a9-9a92-6eddb4d52e6e",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260310T160951Z:f4d69cdb-d05b-44a9-9a92-6eddb4d52e6e",
],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"f4d69cdb-d05b-44a9-9a92-6eddb4d52e6e",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 10 Mar 2026 16:09:50 GMT",
],
"Content-Length": ["542"],
"X-Msedge-Ref": [
"Ref A: 3F20D18F061F48B0A5963AE25F0A156A Ref B: BL2AA2011003040 Ref C: 2026-03-10T16:09:50Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000848540>{
s: "{\"error\":{\"code\":\"InvalidTemplate\",\"message\":\"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\"additionalInfo\":[{\"type\":\"TemplateViolation\",\"info\":{\"lineNumber\":0,\"linePosition\":0,\"path\":\"\"}}]}}",
i: 0,
},
ContentLength: 542,
TransferEncoding: nil,
Close: false,
Uncompress...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000848600>:
failed creating deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-zhtprd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-zhtprd/providers/Microsoft.Resources/deployments/aro-hcp-demo
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidTemplate
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidTemplate",
"message": "Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.",
"additionalInfo": [
{
"type": "TemplateViolation",
"info": {
"lineNumber": 0,
"linePosition": 0,
"path": ""
}
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-zhtprd\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-zhtprd/providers/Microsoft.Resources/deployments/aro-hcp-demo\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidTemplate\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidTemplate\",\n \"message\": \"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\n \"additionalInfo\": [\n {\n \"type\": \"TemplateViolation\",\n \"info\": {\n \"lineNumber\": 0,\n \"linePosition\": 0,\n \"path\": \"\"\n }\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00135a990>{
ErrorCode: "InvalidTemplate",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Request-Id": [
"f4d69cdb-d05b-44a9-9a92-6eddb4d52e6e",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260310T160951Z:f4d69cdb-d05b-44a9-9a92-6eddb4d52e6e",
],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"f4d69cdb-d05b-44a9-9a92-6eddb4d52e6e",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 10 Mar 2026 16:09:50 GMT",
],
"Content-Length": ["542"],
"X-Msedge-Ref": [
"Ref A: 3F20D18F061F48B0A5963AE25F0A156A Ref B: BL2AA2011003040 Ref C: 2026-03-10T16:09:50Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000848540>{
s: "{\"error\":{\"code\":\"InvalidTemplate\",\"message\":\"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\"additionalInfo\":[{\"type\":\"TemplateViolation\",\"info\":{\"lineNumber\":0,\"linePosition\":0,\"path\":\"\"}}]}}",
i: 0,
},
ContentLength: 542,
TransferEncoding: nil,
Close: false,
Uncompress...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:100]: Unexpected error:
<*fmt.wrapError | 0xc0011369c0>:
failed creating deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-6t29q4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-6t29q4/providers/Microsoft.Resources/deployments/aro-hcp-demo
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidTemplate
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidTemplate",
"message": "Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.",
"additionalInfo": [
{
"type": "TemplateViolation",
"info": {
"lineNumber": 0,
"linePosition": 0,
"path": ""
}
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-6t29q4\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-6t29q4/providers/Microsoft.Resources/deployments/aro-hcp-demo\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidTemplate\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidTemplate\",\n \"message\": \"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\n \"additionalInfo\": [\n {\n \"type\": \"TemplateViolation\",\n \"info\": {\n \"lineNumber\": 0,\n \"linePosition\": 0,\n \"path\": \"\"\n }\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000eb44e0>{
ErrorCode: "InvalidTemplate",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"6f0859fb-712e-493d-b9f3-1feb834d30d5",
],
"X-Msedge-Ref": [
"Ref A: 0385E8E79B674F5DB2E6A6AC40C9C59D Ref B: CHI261140506042 Ref C: 2026-03-10T11:15:34Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Length": ["542"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"6f0859fb-712e-493d-b9f3-1feb834d30d5",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 10 Mar 2026 11:15:34 GMT",
],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260310T111535Z:6f0859fb-712e-493d-b9f3-1feb834d30d5",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001136900>{
s: "{\"error\":{\"code\":\"InvalidTemplate\",\"message\":\"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\"additionalInfo\":[{\"type\":\"TemplateViolation\",\"info\":{\"lineNumber\":0,\"linePosition\":0,\"path\":\"\"}}]}}",
i: 0,
},
ContentLength: 542,
TransferEncoding: nil,
Close: false,
Uncompress...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:100]: Unexpected error:
<*fmt.wrapError | 0xc0011369c0>:
failed creating deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-6t29q4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-6t29q4/providers/Microsoft.Resources/deployments/aro-hcp-demo
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidTemplate
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidTemplate",
"message": "Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.",
"additionalInfo": [
{
"type": "TemplateViolation",
"info": {
"lineNumber": 0,
"linePosition": 0,
"path": ""
}
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-6t29q4\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-6t29q4/providers/Microsoft.Resources/deployments/aro-hcp-demo\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidTemplate\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidTemplate\",\n \"message\": \"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\n \"additionalInfo\": [\n {\n \"type\": \"TemplateViolation\",\n \"info\": {\n \"lineNumber\": 0,\n \"linePosition\": 0,\n \"path\": \"\"\n }\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000eb44e0>{
ErrorCode: "InvalidTemplate",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Failure-Cause": ["gateway"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"6f0859fb-712e-493d-b9f3-1feb834d30d5",
],
"X-Msedge-Ref": [
"Ref A: 0385E8E79B674F5DB2E6A6AC40C9C59D Ref B: CHI261140506042 Ref C: 2026-03-10T11:15:34Z",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Length": ["542"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"6f0859fb-712e-493d-b9f3-1feb834d30d5",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 10 Mar 2026 11:15:34 GMT",
],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260310T111535Z:6f0859fb-712e-493d-b9f3-1feb834d30d5",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001136900>{
s: "{\"error\":{\"code\":\"InvalidTemplate\",\"message\":\"Deployment template validation failed: 'The following parameters were supplied, but do not correspond to any parameters defined in the template: 'tags'. The parameters defined in the template are: 'clusterName, identities, openshiftControlPlaneVersionId, openshiftNodePoolVersionId, persistTagValue, usePooledIdentities'. Please see https://aka.ms/arm-pass-parameter-values for usage details.'.\",\"additionalInfo\":[{\"type\":\"TemplateViolation\",\"info\":{\"lineNumber\":0,\"linePosition\":0,\"path\":\"\"}}]}}",
i: 0,
},
ContentLength: 542,
TransferEncoding: nil,
Close: false,
Uncompress...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4full failure pattern: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4 Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 2 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.003s.
Expected success, but got an error:
<*errors.joinError | 0xc001069d10>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc00052cbc0>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0008a6470>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.003s.
Expected success, but got an error:
<*errors.joinError | 0xc001069d10>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc00052cbc0>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0008a6470>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.007s.
Expected success, but got an error:
<*errors.joinError | 0xc000f034d0>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc00051c6c0>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc00073e8e0>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.007s.
Expected success, but got an error:
<*errors.joinError | 0xc000f034d0>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc00051c6c0>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc00073e8e0>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create HCP cluster <cluster>: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:full failure pattern: failed to create HCP cluster <cluster>: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster: Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0008a0960>:
failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc00099a1a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0008a0960>:
failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc00099a1a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc000a8f0c0>:
failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc000883270>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n ...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc000a8f0c0>:
failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc000883270>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n ...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tls: failed to verify certificate: x509: certificate signed by unknown authorityfull failure pattern: tls: failed to verify certificate: x509: certificate signed by unknown authority Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 1 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000a823a0>:
route host was never found: Get "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc000e42f90>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc000e42f60>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 114, 166, 67, 131, 161, 184, 111, 135, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 23, 13, 50, 55, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 171, 245, 160, 214, 154, 112, 110, 204, 15, 86, 252, 179, 142, 130, 204, 217, 67, 231, 80, 41, 211, 147, 178, 160, 199, 200, 19, 133, 194, 136, 107, 25, 205, 159, 224, 164, 94, 54, 213, 194, 9, 2, 39, 153, 159, 182, 30, 99, 28, 89, 174, 87, 251, 131, 183, 135, 149, 251, 25, 26, 246, 85, 215, 7, 185, 228, 60, 170, 238, 173, 185, 45, 187, 63, 62, 71, 219, 1, 167, 58, 113, 193, 15, 83, 125, 72, 62, 225, 213, 0, 30, 100, 96, 63, 222, 138, 215, 7, 113, 236, 46, 113, 180, 77, 72, 159, 20, 116, 127, 106, 175, 124, 52, 171, 102, 102, 125, 106, 245, 232, 50, 94, 155, 47, 139, 171, 73, 104, 176, 220, 217, 144, 14, 210, 223, 73, 231, 249, 58, 60, 20, 188, 126, 222, 169, 103, 58, 172, 238, 65, 131, 97, 189, 124, 71, 208, 75, 222, 172, 10, 44, 246, 85, 212, 138, 44, 12, 116, 23, 200, 18, 17, 120, 148, 120, 59, 104, 178, 65, 32, 48, 174, 59, 46, 184, 149, 195, 222, 251, 181, 125, 181, 41, 236, 44, 186, 10, 195, 113, 56, 174, 50, 218, 177, 166, 171, 70, 182, 176, 215, 167, 107, 222, 155, 174, 75, 48, 177, 103, 121, 71, 167, 121, 123, 192, 0, 214, 51, 78, 47, 43, 31, 69, 64, 241, 128, 46, 138, 99, 231, 163, 162, 178, 178, 119, 52, 72, 114, 148, 145, 187, 250, 113, 114, 123, 189, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 123, 158, 253, 151, 68, 212, 208, 224, 169, 154, 97, 61, 109, 110, 68, 34, 197, 212, 232, 246, 235, 63, 199, 233, 222, 70, 1, 69, 164, 78, 129, 47, 103, 44, 254, 231, 151, 96, 25, 54, 244, 249, 207, 27, 74, 241, 209, 240, 243, 167, 9, 64, 16, 126, 112, 191, 26, 145, 91, 91, 146, 176, 227, 14, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 34, 251, 31, 200, 232, 181, 131, 228, 184, 123, 9, 109, 121, 91, 57, 62, 121, 66, 56, 146, 252, 19, 141, 227, 187, 163, 111, 151, 181, 203, 103, 196, 33, 174, 179, 90, 65, 140, 89, 118, 141, 231, 147, 48, 92, 72, 18, 147, 42, 112, 172, 42, 69, 190, 39, 18, 54, 32, 31, 52, 39, 133, 120, 237, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 109, 54, 106, 52, 103, 53, 103, 57, 121, 55, 116, 49, 116, 51, 118, 46, 120, 48, 56, 99, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 1, 117, 2, 23, 126, 151, 17, 52, 168, 52, 116, 165, 29, 56, 57, 228, 177, 201, 254, 123, 25...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000a823a0>:
route host was never found: Get "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc000e42f90>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc000e42f60>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 114, 166, 67, 131, 161, 184, 111, 135, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 23, 13, 50, 55, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 171, 245, 160, 214, 154, 112, 110, 204, 15, 86, 252, 179, 142, 130, 204, 217, 67, 231, 80, 41, 211, 147, 178, 160, 199, 200, 19, 133, 194, 136, 107, 25, 205, 159, 224, 164, 94, 54, 213, 194, 9, 2, 39, 153, 159, 182, 30, 99, 28, 89, 174, 87, 251, 131, 183, 135, 149, 251, 25, 26, 246, 85, 215, 7, 185, 228, 60, 170, 238, 173, 185, 45, 187, 63, 62, 71, 219, 1, 167, 58, 113, 193, 15, 83, 125, 72, 62, 225, 213, 0, 30, 100, 96, 63, 222, 138, 215, 7, 113, 236, 46, 113, 180, 77, 72, 159, 20, 116, 127, 106, 175, 124, 52, 171, 102, 102, 125, 106, 245, 232, 50, 94, 155, 47, 139, 171, 73, 104, 176, 220, 217, 144, 14, 210, 223, 73, 231, 249, 58, 60, 20, 188, 126, 222, 169, 103, 58, 172, 238, 65, 131, 97, 189, 124, 71, 208, 75, 222, 172, 10, 44, 246, 85, 212, 138, 44, 12, 116, 23, 200, 18, 17, 120, 148, 120, 59, 104, 178, 65, 32, 48, 174, 59, 46, 184, 149, 195, 222, 251, 181, 125, 181, 41, 236, 44, 186, 10, 195, 113, 56, 174, 50, 218, 177, 166, 171, 70, 182, 176, 215, 167, 107, 222, 155, 174, 75, 48, 177, 103, 121, 71, 167, 121, 123, 192, 0, 214, 51, 78, 47, 43, 31, 69, 64, 241, 128, 46, 138, 99, 231, 163, 162, 178, 178, 119, 52, 72, 114, 148, 145, 187, 250, 113, 114, 123, 189, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 123, 158, 253, 151, 68, 212, 208, 224, 169, 154, 97, 61, 109, 110, 68, 34, 197, 212, 232, 246, 235, 63, 199, 233, 222, 70, 1, 69, 164, 78, 129, 47, 103, 44, 254, 231, 151, 96, 25, 54, 244, 249, 207, 27, 74, 241, 209, 240, 243, 167, 9, 64, 16, 126, 112, 191, 26, 145, 91, 91, 146, 176, 227, 14, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 34, 251, 31, 200, 232, 181, 131, 228, 184, 123, 9, 109, 121, 91, 57, 62, 121, 66, 56, 146, 252, 19, 141, 227, 187, 163, 111, 151, 181, 203, 103, 196, 33, 174, 179, 90, 65, 140, 89, 118, 141, 231, 147, 48, 92, 72, 18, 147, 42, 112, 172, 42, 69, 190, 39, 18, 54, 32, 31, 52, 39, 133, 120, 237, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 109, 54, 106, 52, 103, 53, 103, 57, 121, 55, 116, 49, 116, 51, 118, 46, 120, 48, 56, 99, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 1, 117, 2, 23, 126, 151, 17, 52, 168, 52, 116, 165, 29, 56, 57, 228, 177, 201, 254, 123, 25...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000990340>:
route host was never found: Get "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc0007be420>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc0007be3f0>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 62, 25, 86, 167, 141, 77, 254, 108, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 23, 13, 50, 55, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 154, 196, 158, 50, 70, 80, 204, 182, 160, 172, 151, 181, 43, 129, 253, 116, 246, 14, 238, 184, 4, 124, 112, 234, 197, 64, 118, 130, 70, 165, 85, 204, 119, 169, 211, 45, 1, 247, 228, 44, 39, 229, 14, 185, 24, 141, 119, 45, 226, 142, 14, 32, 37, 145, 246, 92, 109, 96, 89, 151, 254, 66, 203, 37, 198, 101, 83, 180, 5, 211, 94, 23, 86, 222, 103, 88, 129, 217, 187, 126, 171, 156, 121, 195, 212, 180, 239, 253, 30, 45, 71, 6, 210, 99, 238, 57, 64, 241, 71, 57, 12, 70, 51, 65, 128, 98, 120, 243, 38, 33, 250, 230, 25, 71, 203, 120, 119, 200, 149, 220, 196, 66, 189, 247, 153, 232, 95, 193, 76, 47, 157, 202, 46, 80, 218, 25, 74, 232, 156, 124, 153, 4, 24, 0, 14, 249, 127, 249, 245, 76, 23, 167, 62, 228, 132, 254, 149, 119, 6, 211, 144, 200, 219, 162, 56, 106, 101, 143, 126, 234, 136, 238, 47, 125, 108, 35, 192, 68, 165, 94, 219, 34, 76, 63, 177, 20, 69, 59, 130, 222, 182, 233, 169, 25, 78, 77, 1, 88, 28, 27, 0, 84, 69, 98, 67, 141, 113, 244, 4, 115, 103, 95, 78, 108, 211, 190, 40, 23, 50, 161, 231, 118, 194, 253, 133, 95, 253, 153, 138, 160, 175, 204, 19, 95, 206, 123, 101, 183, 195, 54, 219, 75, 116, 76, 63, 141, 195, 170, 251, 247, 255, 73, 236, 132, 224, 71, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 147, 148, 51, 188, 52, 103, 20, 165, 56, 193, 201, 93, 18, 119, 65, 54, 150, 243, 183, 3, 151, 99, 9, 110, 215, 199, 80, 56, 25, 9, 1, 18, 64, 80, 40, 65, 112, 190, 37, 160, 0, 107, 208, 164, 10, 113, 122, 124, 172, 135, 103, 28, 119, 242, 189, 227, 75, 85, 192, 32, 43, 117, 231, 141, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 243, 119, 37, 142, 132, 226, 104, 177, 2, 226, 195, 219, 230, 16, 46, 175, 130, 189, 157, 67, 86, 226, 172, 98, 47, 7, 28, 93, 189, 9, 171, 122, 8, 57, 89, 195, 140, 227, 185, 222, 202, 237, 239, 107, 152, 109, 113, 52, 177, 66, 65, 94, 2, 246, 138, 40, 181, 44, 74, 137, 16, 188, 152, 212, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 116, 54, 111, 49, 107, 54, 122, 52, 99, 48, 108, 57, 99, 48, 114, 46, 107, 97, 115, 97, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 19, 241, 101, 78, 187, 200, 215, 57, 27, 17, 46, 244, 209, 206, 109, 209, 19, 39, 101, 140, 118, 186, 198, 21, 202, 1,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000990340>:
route host was never found: Get "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc0007be420>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc0007be3f0>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 62, 25, 86, 167, 141, 77, 254, 108, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 23, 13, 50, 55, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 154, 196, 158, 50, 70, 80, 204, 182, 160, 172, 151, 181, 43, 129, 253, 116, 246, 14, 238, 184, 4, 124, 112, 234, 197, 64, 118, 130, 70, 165, 85, 204, 119, 169, 211, 45, 1, 247, 228, 44, 39, 229, 14, 185, 24, 141, 119, 45, 226, 142, 14, 32, 37, 145, 246, 92, 109, 96, 89, 151, 254, 66, 203, 37, 198, 101, 83, 180, 5, 211, 94, 23, 86, 222, 103, 88, 129, 217, 187, 126, 171, 156, 121, 195, 212, 180, 239, 253, 30, 45, 71, 6, 210, 99, 238, 57, 64, 241, 71, 57, 12, 70, 51, 65, 128, 98, 120, 243, 38, 33, 250, 230, 25, 71, 203, 120, 119, 200, 149, 220, 196, 66, 189, 247, 153, 232, 95, 193, 76, 47, 157, 202, 46, 80, 218, 25, 74, 232, 156, 124, 153, 4, 24, 0, 14, 249, 127, 249, 245, 76, 23, 167, 62, 228, 132, 254, 149, 119, 6, 211, 144, 200, 219, 162, 56, 106, 101, 143, 126, 234, 136, 238, 47, 125, 108, 35, 192, 68, 165, 94, 219, 34, 76, 63, 177, 20, 69, 59, 130, 222, 182, 233, 169, 25, 78, 77, 1, 88, 28, 27, 0, 84, 69, 98, 67, 141, 113, 244, 4, 115, 103, 95, 78, 108, 211, 190, 40, 23, 50, 161, 231, 118, 194, 253, 133, 95, 253, 153, 138, 160, 175, 204, 19, 95, 206, 123, 101, 183, 195, 54, 219, 75, 116, 76, 63, 141, 195, 170, 251, 247, 255, 73, 236, 132, 224, 71, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 147, 148, 51, 188, 52, 103, 20, 165, 56, 193, 201, 93, 18, 119, 65, 54, 150, 243, 183, 3, 151, 99, 9, 110, 215, 199, 80, 56, 25, 9, 1, 18, 64, 80, 40, 65, 112, 190, 37, 160, 0, 107, 208, 164, 10, 113, 122, 124, 172, 135, 103, 28, 119, 242, 189, 227, 75, 85, 192, 32, 43, 117, 231, 141, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 243, 119, 37, 142, 132, 226, 104, 177, 2, 226, 195, 219, 230, 16, 46, 175, 130, 189, 157, 67, 86, 226, 172, 98, 47, 7, 28, 93, 189, 9, 171, 122, 8, 57, 89, 195, 140, 227, 185, 222, 202, 237, 239, 107, 152, 109, 113, 52, 177, 66, 65, 94, 2, 246, 138, 40, 181, 44, 74, 137, 16, 188, 152, 212, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 116, 54, 111, 49, 107, 54, 122, 52, 99, 48, 108, 57, 99, 48, 114, 46, 107, 97, 115, 97, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 19, 241, 101, 78, 187, 200, 215, 57, 27, 17, 46, 244, 209, 206, 109, 209, 19, 39, 101, 140, 118, 186, 198, 21, 202, 1,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InvalidRequestContent; detail message Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InvalidRequestContent; detail message Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 9 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapError | 0xc00171c6c0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-g975c2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-g975c2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-g975c2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-g975c2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00171c6a0>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-g975c2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-g975c2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009663c0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["170"],
"X-Ms-Correlation-Request-Id": [
"cf3a6b30-b9f9-40f5-860b-db7a4db99729",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T231200Z:cf3a6b30-b9f9-40f5-860b-db7a4db99729",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 1334633E7ABC4C9D961015632B4669DE Ref B: CHI261140502060 Ref C: 2026-03-12T23:11:59Z",
],
"Date": [
"Thu, 12 Mar 2026 23:11:59 GMT",
],
"X-Envoy-Upstream-Service-Time": ["201"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/67d0f8c8-def2-4e27-b339-fb62d5a3d936",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"f425ba51-7086-4447-8016-171717a6c5ab",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapError | 0xc00171c6c0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-g975c2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-g975c2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-g975c2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-g975c2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00171c6a0>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-g975c2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-g975c2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009663c0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["170"],
"X-Ms-Correlation-Request-Id": [
"cf3a6b30-b9f9-40f5-860b-db7a4db99729",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T231200Z:cf3a6b30-b9f9-40f5-860b-db7a4db99729",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 1334633E7ABC4C9D961015632B4669DE Ref B: CHI261140502060 Ref C: 2026-03-12T23:11:59Z",
],
"Date": [
"Thu, 12 Mar 2026 23:11:59 GMT",
],
"X-Envoy-Upstream-Service-Time": ["201"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/67d0f8c8-def2-4e27-b339-fb62d5a3d936",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"f425ba51-7086-4447-8016-171717a6c5ab",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:114]: Unexpected error:
<*fmt.wrapError | 0xc001408120>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-8t5md5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8t5md5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-8t5md5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8t5md5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc001408100>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-8t5md5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8t5md5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000c90fc0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["2649"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T231012Z:014d9526-d846-4eb1-91c9-ca8a5c50bfbd",
],
"X-Msedge-Ref": [
"Ref A: 8080CB14631643F1BD10EDD83999FADD Ref B: CHI261140513054 Ref C: 2026-03-12T23:10:10Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["170"],
"Expires": ["-1"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/9e990a7a-bc1c-4fa5-84e6-6d350f3c8cfe",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 23:10:12 GMT",
],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"014d9526-d846-4eb1-91c9-ca8a5c50bfbd",
],
"Cache-Control": ["no-cache"],
"Content-Ty...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:114]: Unexpected error:
<*fmt.wrapError | 0xc001408120>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-8t5md5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8t5md5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-8t5md5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8t5md5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc001408100>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-8t5md5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8t5md5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000c90fc0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["2649"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T231012Z:014d9526-d846-4eb1-91c9-ca8a5c50bfbd",
],
"X-Msedge-Ref": [
"Ref A: 8080CB14631643F1BD10EDD83999FADD Ref B: CHI261140513054 Ref C: 2026-03-12T23:10:10Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["170"],
"Expires": ["-1"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/9e990a7a-bc1c-4fa5-84e6-6d350f3c8cfe",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 23:10:12 GMT",
],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"014d9526-d846-4eb1-91c9-ca8a5c50bfbd",
],
"Cache-Control": ["no-cache"],
"Content-Ty...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc00087e580>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-mq56rt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-mq56rt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mq56rt\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-mq56rt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00087e560>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mq56rt\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-mq56rt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e0e090>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"95277bb3-59de-4af9-a6be-d794c22ffea6",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: DECDB7E93FD643FFB79BD2D9D72D81DF Ref B: CHI261140510025 Ref C: 2026-03-12T22:52:58Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["170"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T225305Z:9b9678c6-264f-423d-bafc-7733fb8aa855",
],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Envoy-Upstream-Service-Time": ["7627"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a50444fe-08f0-4f32-b20a-20c19b8c9e0e",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"9b9678c6-264f-423d-bafc-7733fb8aa855",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc00087e580>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-mq56rt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-mq56rt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mq56rt\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-mq56rt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00087e560>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mq56rt\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-mq56rt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e0e090>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"95277bb3-59de-4af9-a6be-d794c22ffea6",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: DECDB7E93FD643FFB79BD2D9D72D81DF Ref B: CHI261140510025 Ref C: 2026-03-12T22:52:58Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["170"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T225305Z:9b9678c6-264f-423d-bafc-7733fb8aa855",
],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Envoy-Upstream-Service-Time": ["7627"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a50444fe-08f0-4f32-b20a-20c19b8c9e0e",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"9b9678c6-264f-423d-bafc-7733fb8aa855",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (9)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 2 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc000d805d0>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-582s69" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001231ee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69",
},
<*fmt.wrapError | 0xc001534340>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc000d805d0>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-582s69" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001231ee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69",
},
<*fmt.wrapError | 0xc001534340>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapErrors | 0xc001507500>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-c9z2w2" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0009d8fd0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2",
},
<*fmt.wrapError | 0xc000c01760>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapErrors | 0xc001507500>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-c9z2w2" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0009d8fd0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2",
},
<*fmt.wrapError | 0xc000c01760>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredContributing tests (2)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; context ; provider Microsoft.Networkfull failure pattern: ERROR CODE: InternalServerError; context ; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 2 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapError | 0xc000c720a0>:
failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-qkwf4p" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619",
"name": "0b05f658-bbb6-452d-b845-92443ec2c619",
"status": "Failed",
"startTime": "2026-03-11T03:36:35.705780329Z",
"endTime": "2026-03-11T03:38:07.574131728Z",
"error": {
"code": "InternalServerError",
"message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"message\": \"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000c72080>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00144fd10>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapError | 0xc000c720a0>:
failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-qkwf4p" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619",
"name": "0b05f658-bbb6-452d-b845-92443ec2c619",
"status": "Failed",
"startTime": "2026-03-11T03:36:35.705780329Z",
"endTime": "2026-03-11T03:38:07.574131728Z",
"error": {
"code": "InternalServerError",
"message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"message\": \"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000c72080>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00144fd10>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0000d9940>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-6h5tqt" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
"name": "5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
"status": "Failed",
"startTime": "2026-03-11T03:36:37.014555279Z",
"endTime": "2026-03-11T03:38:07.990052924Z",
"error": {
"code": "InternalServerError",
"message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"message\": \"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0000d9900>{
msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f006c0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0000d9940>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-6h5tqt" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
"name": "5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
"status": "Failed",
"startTime": "2026-03-11T03:36:37.014555279Z",
"endTime": "2026-03-11T03:38:07.990052924Z",
"error": {
"code": "InternalServerError",
"message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"message\": \"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0000d9900>{
msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f006c0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Admin credential 1 should fail after revocation, last error: <nil>full failure pattern: Admin credential 1 should fail after revocation, last error: <nil> Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 1 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:222]: Admin credential 1 should fail after revocation, last error: <nil>
Unexpected error:
<context.deadlineExceededError>:
context deadline exceeded
{}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:222]: Admin credential 1 should fail after revocation, last error: <nil>
Unexpected error:
<context.deadlineExceededError>:
context deadline exceeded
{}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle: Cluster provisioning failedfull failure pattern: Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle: Cluster provisioning failed Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:152]: Cluster provisioning failed fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:152]: Cluster provisioning failed Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Resource is already deleting; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Resource is already deleting; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 1 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000d78048>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Resource is already deleting",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc001509a00>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Resource is already deleting\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0015099e0>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Resource is already deleting\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009cc510>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["295"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["3000"],
"X-Ms-Correlation-Request-Id": [
"36e4392a-0d35-4147-8a9f-6300ad30a25c",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T050748Z:36e4392a-0d35-4147-8a9f-6300ad30a25c",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"9240eef9-4396-4070-b424-2e847f902062",
],
"X-Envoy-Upstream-Service-Time": ["32460"],
"X-Ms-Ratelimit-Remaining-Subscription-Deletes": ["200"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 09 Mar 2026 05:07:47 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/1795cff2-640d-4155-ab23-dd61fa932a34",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000d78048>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Resource is already deleting",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc001509a00>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Resource is already deleting\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0015099e0>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Resource is already deleting\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-sqdgm5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-vzqchl\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009cc510>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["295"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["3000"],
"X-Ms-Correlation-Request-Id": [
"36e4392a-0d35-4147-8a9f-6300ad30a25c",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T050748Z:36e4392a-0d35-4147-8a9f-6300ad30a25c",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"9240eef9-4396-4070-b424-2e847f902062",
],
"X-Envoy-Upstream-Service-Time": ["32460"],
"X-Ms-Ratelimit-Remaining-Subscription-Deletes": ["200"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 09 Mar 2026 05:07:47 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/1795cff2-640d-4155-ab23-dd61fa932a34",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code InvalidRequestContent; detail message Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'full failure pattern: ERROR CODE: DeploymentFailed; detail code InvalidRequestContent; detail message Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8' Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 1 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000fc6740>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-w6hmz9" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584282515392752534
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/nodepool-1\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"InvalidRequestContent\",\r\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-w6hmz9\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584282515392752534\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/nodepool-1\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"InvalidRequestContent\\\",\\r\\n \\\"message\\\": \\\"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001500e10>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Content-Length": ["1243"],
"X-Ms-Request-Id": [
"0d231ad8-8318-4e3a-920c-9541e2affd70",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"0d231ad8-8318-4e3a-920c-9541e2affd70",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3748"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T225347Z:0d231ad8-8318-4e3a-920c-9541e2affd70",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 4733BC488DE8424898A45EF16542E708 Ref B: CH1AA2020603045 Ref C: 2026-03-12T22:53:47Z",
],
"Date": [
"Thu, 12 Mar 2026 22:53:46 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000fc6620>{
s:...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000fc6740>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-w6hmz9" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584282515392752534
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/nodepool-1\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"InvalidRequestContent\",\r\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-w6hmz9\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584282515392752534\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-w6hmz9/providers/Microsoft.Resources/deployments/nodepool-1\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"InvalidRequestContent\\\",\\r\\n \\\"message\\\": \\\"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001500e10>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Content-Length": ["1243"],
"X-Ms-Request-Id": [
"0d231ad8-8318-4e3a-920c-9541e2affd70",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"0d231ad8-8318-4e3a-920c-9541e2affd70",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3748"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260312T225347Z:0d231ad8-8318-4e3a-920c-9541e2affd70",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 4733BC488DE8424898A45EF16542E708 Ref B: CH1AA2020603045 Ref C: 2026-03-12T22:53:47Z",
],
"Date": [
"Thu, 12 Mar 2026 22:53:46 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000fc6620>{
s:...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code TokenNotActive; provider Microsoft.ContainerRegistryfull failure pattern: ERROR CODE: DeploymentFailed; detail code TokenNotActive; provider Microsoft.ContainerRegistry Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc0006285a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-5bhbw5" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"InternalServerError\",\r\n \"message\": \"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: TokenNotActive\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"TokenNotActive\\\",\\n \\\"message\\\": \\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\"\\n },\\n \\\"status\\\": \\\"Failed\\\"\\n}\\n--------------------------------------------------------------------------------\\n\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-5bhbw5\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"InternalServerError\\\",\\r\\n \\\"message\\\": \\\"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\\\n--------------------------------------------------------------------------------\\\\nRESPONSE 409: 409 Conflict\\\\nERROR CODE: TokenNotActive\\\\n--------------------------------------------------------------------------------\\\\n{\\\\n \\\\\\\"error\\\\\\\": {\\\\n \\\\\\\"code\\\\\\\": \\\\\\\"TokenNotActive\\\\\\\",\\\\n \\\\\\\"message\\\\\\\": \\\\\\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\\\\\"\\\\n },\\\\n \\\\\\\"status\\\\\\\": \\\\\\\"Failed\\\\\\\"\\\\n}\\\\n--------------------------------------------------------------------------------\\\\n\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000968600>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-R...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc0006285a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-5bhbw5" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"InternalServerError\",\r\n \"message\": \"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: TokenNotActive\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"TokenNotActive\\\",\\n \\\"message\\\": \\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\"\\n },\\n \\\"status\\\": \\\"Failed\\\"\\n}\\n--------------------------------------------------------------------------------\\n\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-5bhbw5\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"InternalServerError\\\",\\r\\n \\\"message\\\": \\\"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\\\n--------------------------------------------------------------------------------\\\\nRESPONSE 409: 409 Conflict\\\\nERROR CODE: TokenNotActive\\\\n--------------------------------------------------------------------------------\\\\n{\\\\n \\\\\\\"error\\\\\\\": {\\\\n \\\\\\\"code\\\\\\\": \\\\\\\"TokenNotActive\\\\\\\",\\\\n \\\\\\\"message\\\\\\\": \\\\\\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\\\\\"\\\\n },\\\\n \\\\\\\"status\\\\\\\": \\\\\\\"Failed\\\\\\\"\\\\n}\\\\n--------------------------------------------------------------------------------\\\\n\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000968600>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-R...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 1 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapError | 0xc0012ecd00>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-9wh75v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 500: 500 Internal Server Error
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"error": {
"code": "InternalServerError",
"message": "Internal server error."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-9wh75v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"Internal server error.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00130de60>{
ErrorCode: "InternalServerError",
StatusCode: 500,
RawResponse: {
Status: "500 Internal Server Error",
StatusCode: 500,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"aded1fbf-5095-4f14-957e-7e4810dfa7b7",
],
"X-Envoy-Upstream-Service-Time": ["1537"],
"Cache-Control": ["no-cache"],
"X-Ms-Error-Code": [
"InternalServerError",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/ffa8e515-a5e8-40aa-9ef9-9df55097710b",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T155315Z:1e0a595f-913b-42ed-b06c-d8a52395722d",
],
"X-Msedge-Ref": [
"Ref A: D4B3120337FD4E1A835EB7502426C822 Ref B: CH1AA2020603037 Ref C: 2026-03-09T15:53:13Z",
],
"Date": [
"Mon, 09 Mar 2026 15:53:14 GMT",
],
"Content-Length": ["107"],
"X-Ms-Correlation-Request-Id": [
"1e0a595f-913b-42ed-b06c-d8a52395722d",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
},
Body: <*exported.nopClosingBytesReader | 0xc0012ecc40>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 107,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
H...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapError | 0xc0012ecd00>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-9wh75v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 500: 500 Internal Server Error
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"error": {
"code": "InternalServerError",
"message": "Internal server error."
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-9wh75v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"Internal server error.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00130de60>{
ErrorCode: "InternalServerError",
StatusCode: 500,
RawResponse: {
Status: "500 Internal Server Error",
StatusCode: 500,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"aded1fbf-5095-4f14-957e-7e4810dfa7b7",
],
"X-Envoy-Upstream-Service-Time": ["1537"],
"Cache-Control": ["no-cache"],
"X-Ms-Error-Code": [
"InternalServerError",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/ffa8e515-a5e8-40aa-9ef9-9df55097710b",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T155315Z:1e0a595f-913b-42ed-b06c-d8a52395722d",
],
"X-Msedge-Ref": [
"Ref A: D4B3120337FD4E1A835EB7502426C822 Ref B: CH1AA2020603037 Ref C: 2026-03-09T15:53:13Z",
],
"Date": [
"Mon, 09 Mar 2026 15:53:14 GMT",
],
"Content-Length": ["107"],
"X-Ms-Correlation-Request-Id": [
"1e0a595f-913b-42ed-b06c-d8a52395722d",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
},
Body: <*exported.nopClosingBytesReader | 0xc0012ecc40>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 107,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
H...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail code Conflict; detail message A new key vault certificate can not be created or imported while a pending key vault certificate's status is ...full failure pattern: ERROR CODE: InternalServerError; detail code Conflict; detail message A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0009888e0>:
failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-x5k9j9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc",
"name": "2341bf58-c016-4ade-9bc6-f089753ac4bc",
"status": "Failed",
"startTime": "2026-03-03T21:26:33.61172742Z",
"endTime": "2026-03-03T21:31:02.021822414Z",
"error": {
"code": "InternalServerError",
"message": "POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009888c0>{
msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008c4e40>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0009888e0>:
failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-x5k9j9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc",
"name": "2341bf58-c016-4ade-9bc6-f089753ac4bc",
"status": "Failed",
"startTime": "2026-03-03T21:26:33.61172742Z",
"endTime": "2026-03-03T21:31:02.021822414Z",
"error": {
"code": "InternalServerError",
"message": "POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009888c0>{
msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008c4e40>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message failed to run transaction handler: Managed clusters on AWS need an account claim before installing; provider Microsoft.RedHatOpenSh...full failure pattern: ERROR CODE: InternalServerError; detail message failed to run transaction handler: Managed clusters on AWS need an account claim before installing; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc00088dea0>:
failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-tq9pcx" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232",
"name": "09aabd4d-8689-4a5c-8bb1-c3538510c232",
"status": "Failed",
"startTime": "2026-03-03T21:26:38.133961239Z",
"endTime": "2026-03-03T21:31:47.042145346Z",
"error": {
"code": "InternalServerError",
"message": "failed to run transaction handler: Managed clusters on AWS need an account claim before installing"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00088de80>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001289530>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["25"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/canadaeast/3ffbf395-fb71-49fa-8da8-4aab58175900",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["248"],
"X-Ms-Correlation-Request-Id": [
"e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3748"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 7F476DA1539542E4A76F035388135DE5 Ref B: CHI261140509060 Ref C: 2026-03-03T21:31:49Z",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T213149Z:e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
]...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc00088dea0>:
failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-tq9pcx" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232",
"name": "09aabd4d-8689-4a5c-8bb1-c3538510c232",
"status": "Failed",
"startTime": "2026-03-03T21:26:38.133961239Z",
"endTime": "2026-03-03T21:31:47.042145346Z",
"error": {
"code": "InternalServerError",
"message": "failed to run transaction handler: Managed clusters on AWS need an account claim before installing"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00088de80>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001289530>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["25"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/canadaeast/3ffbf395-fb71-49fa-8da8-4aab58175900",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["248"],
"X-Ms-Correlation-Request-Id": [
"e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3748"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 7F476DA1539542E4A76F035388135DE5 Ref B: CHI261140509060 Ref C: 2026-03-03T21:31:49Z",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T213149Z:e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
]...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InvalidRequestContent; detail message Duplicate ARO-HCP cluster <cluster>. An ARO-HCP cluster <cluster> name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXX...full failure pattern: ERROR CODE: InvalidRequestContent; detail message Duplicate ARO-HCP cluster <cluster>. An ARO-HCP cluster <cluster> name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure resource group <resource-group> 'patch-name-<id>' already exists; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc00074a1e0>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-dw4sft": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00074a1a0>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011ca330>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ebd6fb37-603d-40fd-a0f5-541cb70c6055",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"Content-Length": ["300"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"9ea6c029-e86c-4435-81b6-ed0298c892ac",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 67BEEBA6A2544538A4518981F15930C8 Ref B: CHI261140512054 Ref C: 2026-03-03T21:30:35Z",
],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 21:30:52 GMT",
],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["17856"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uks...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc00074a1e0>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-dw4sft": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00074a1a0>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011ca330>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ebd6fb37-603d-40fd-a0f5-541cb70c6055",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"Content-Length": ["300"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"9ea6c029-e86c-4435-81b6-ed0298c892ac",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 67BEEBA6A2544538A4518981F15930C8 Ref B: CHI261140512054 Ref C: 2026-03-03T21:30:35Z",
],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 21:30:52 GMT",
],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["17856"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uks...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Should receive valid HTTP status code from authorized IPfull failure pattern: Should receive valid HTTP status code from authorized IP Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 1 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.002s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.002s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Timed out after 120.345s.full failure pattern: Timed out after 120.345s. Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 1 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.345s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:162 with:
Unexpected error:
<context.deadlineExceededError>:
context deadline exceeded
{}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.345s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:162 with:
Unexpected error:
<context.deadlineExceededError>:
context deadline exceeded
{}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
client rate limiter Wait returned an error: context deadline exceededfull failure pattern: client rate limiter Wait returned an error: context deadline exceeded Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:222]: Admin credential 1 should fail after revocation, last error: client rate limiter Wait returned an error: context deadline exceeded
Unexpected error:
<context.deadlineExceededError>:
context deadline exceeded
{}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:222]: Admin credential 1 should fail after revocation, last error: client rate limiter Wait returned an error: context deadline exceeded
Unexpected error:
<context.deadlineExceededError>:
context deadline exceeded
{}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create nodepool <nodepool>: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:full failure pattern: failed to create nodepool <nodepool>: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool: Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapError | 0xc0014d2ca0>:
failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:
&armredhatopenshifthcp.NodePool{
Location: &"uksouth",
Identity: nil,
Properties: &armredhatopenshifthcp.NodePoolProperties{
... // 6 identical fields
Taints: nil,
Version: &{ChannelGroup: &"stable", ID: &"4.20.8"},
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: nil,
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc0008972a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapError | 0xc0014d2ca0>:
failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:
&armredhatopenshifthcp.NodePool{
Location: &"uksouth",
Identity: nil,
Properties: &armredhatopenshifthcp.NodePoolProperties{
... // 6 identical fields
Taints: nil,
Version: &{ChannelGroup: &"stable", ID: &"4.20.8"},
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: nil,
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc0008972a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create route: the server is currently unable to handle the requestfull failure pattern: failed to create route: the server is currently unable to handle the request Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc000b90f40>:
failed to create route: the server is currently unable to handle the request
{
msg: "failed to create route: the server is currently unable to handle the request",
err: <*errors.StatusError | 0xc000cf1900>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "the server is currently unable to handle the request",
Reason: "ServiceUnavailable",
Details: {
Name: "",
Group: "",
Kind: "",
UID: "",
Causes: [
{
Type: "UnexpectedServerResponse",
Message: "error trying to reach service: EOF",
Field: "",
},
],
RetryAfterSeconds: 0,
},
Code: 503,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc000b90f40>:
failed to create route: the server is currently unable to handle the request
{
msg: "failed to create route: the server is currently unable to handle the request",
err: <*errors.StatusError | 0xc000cf1900>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "the server is currently unable to handle the request",
Reason: "ServiceUnavailable",
Details: {
Name: "",
Group: "",
Kind: "",
UID: "",
Causes: [
{
Type: "UnexpectedServerResponse",
Message: "error trying to reach service: EOF",
Field: "",
},
],
RetryAfterSeconds: 0,
},
Code: 503,
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
or adjust the parameters in Gomega's 'format' package.full failure pattern: or adjust the parameters in Gomega's 'format' package. Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000a81350>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: NotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NotFound",
"message": "Cluster '2opo4ancuu56jge964b3jdk5rp5s8av4' not found"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "NotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["1482"],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["NotFound"],
"X-Ms-Request-Id": [
"8ac7b452-c6c1-4830-86df-2b2bdbf83106",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T181711Z:8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Msedge-Ref": [
"Ref A: BB9552B9B9FF49CB83494FAF7F2CE729 Ref B: CHI261140505062 Ref C: 2026-03-02T18:17:09Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["126"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Mon, 02 Mar 2026 18:17:11 GMT",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
},
Body: <*exported.nopClosingBytesReader | 0xc001728500>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 108, 117, 115, 116, 101, 114, 32, 39, 50, 111, 112, 111, 52, 97, 110, 99, 117, 117, 53, 54, 106, 103, 101, 57, 54, 52, 98, 51, 106, 100, 107, 53, 114, 112, 53, 115, 56, 97, 118, 52, 39, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 126,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000a81350>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: NotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NotFound",
"message": "Cluster '2opo4ancuu56jge964b3jdk5rp5s8av4' not found"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "NotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["1482"],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["NotFound"],
"X-Ms-Request-Id": [
"8ac7b452-c6c1-4830-86df-2b2bdbf83106",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T181711Z:8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Msedge-Ref": [
"Ref A: BB9552B9B9FF49CB83494FAF7F2CE729 Ref B: CHI261140505062 Ref C: 2026-03-02T18:17:09Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["126"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Mon, 02 Mar 2026 18:17:11 GMT",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
},
Body: <*exported.nopClosingBytesReader | 0xc001728500>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 108, 117, 115, 116, 101, 114, 32, 39, 50, 111, 112, 111, 52, 97, 110, 99, 117, 117, 53, 54, 106, 103, 101, 57, 54, 52, 98, 51, 106, 100, 107, 53, 114, 112, 53, 115, 56, 97, 118, 52, 39, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 126,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nilContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
subscription state not foundfull failure pattern: subscription state not found Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.005s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000970530>:
subscription state not found
{
s: "subscription state not found",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.005s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000970530>:
subscription state not found
{
s: "subscription state not found",
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Environment: STG
E2E Jobs
36
Success Rate
52.78%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.55.88% (19/34)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 72.73% | 11 | stage/parallel | Control plane automated z-stream upgrade with candidate channel should perform an automated control plane z-stream upgrade using the candidate channel | |
| 77.78% | 18 | stage/parallel | Customer should be able to create a cluster with an external auth config and get the external auth config | |
| 83.33% | 18 | stage/parallel | Customer should be able to create an HCP cluster and custom node pool osDisk size | |
| 83.33% | 18 | stage/parallel | Customer should be able to create node pools with ARM64-based VMs | |
| 83.33% | 18 | stage/parallel | Customer should create an HCP cluster and validate TLS certificates |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | e2e | 4 | 11.11%4 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 36 · Mar 7: 18 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014f2ae0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-j85dmd" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<*fmt.wrapErrors | 0xc0014f2ab0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014f2ae0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-j85dmd" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<*fmt.wrapErrors | 0xc0014f2ab0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapErrors | 0xc0015f8780>:
failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-48hdws" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<*fmt.wrapErrors | 0xc0015f8750>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapErrors | 0xc0015f8780>:
failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-48hdws" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<*fmt.wrapErrors | 0xc0015f8750>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error:
<*fmt.wrapErrors | 0xc00146b350>:
failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-xfbcmt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded
{
msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<*fmt.wrapErrors | 0xc00146b320>{
msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error:
<*fmt.wrapErrors | 0xc00146b350>:
failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-xfbcmt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded
{
msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<*fmt.wrapErrors | 0xc00146b320>{
msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (18)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 4 | 11.11%4 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 2 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 4 · Mar 14: 0 · Mar 15: 0 | INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapError | 0xc000bea540>:
failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-d9rlj5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000bea520>{
msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0012ae630>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Envoy-Upstream-Service-Time": ["10019"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: ADF6D0781C9D48D8A5C81735B6310D6F Ref B: CHI261140512034 Ref C: 2026-03-13T07:15:12Z",
],
"Date": [
"Fri, 13 Mar 2026 07:15:21 GMT",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b3f3604-a2f9-4117-8f92-506228f3e7af",
],
"Pragma": ["no-cache"],
"Content-Length": ["186"],
"X-Ms-Request-Id": [
"8c39947a-1214-430d-8010-f0929133b44f",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"dafc4310-6617-45a5-b396-fc80a09e00a8",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapError | 0xc000bea540>:
failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-d9rlj5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000bea520>{
msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0012ae630>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Envoy-Upstream-Service-Time": ["10019"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: ADF6D0781C9D48D8A5C81735B6310D6F Ref B: CHI261140512034 Ref C: 2026-03-13T07:15:12Z",
],
"Date": [
"Fri, 13 Mar 2026 07:15:21 GMT",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b3f3604-a2f9-4117-8f92-506228f3e7af",
],
"Pragma": ["no-cache"],
"Content-Length": ["186"],
"X-Ms-Request-Id": [
"8c39947a-1214-430d-8010-f0929133b44f",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"dafc4310-6617-45a5-b396-fc80a09e00a8",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000fd40f0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc001786300>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0017862e0>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0013d0540>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Deletes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CC4F23FE193F4C1FB16C204ED434C9F4 Ref B: CHI261140510042 Ref C: 2026-03-13T03:16:52Z",
],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/fbb98992-521d-40e7-b146-c0dfb4a73360",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"],
"Date": [
"Fri, 13 Mar 2026 03:17:01 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Correlation-Request-Id": [
"f2fd7682-45a9-47f9-a802-ee0323a08a2f",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T031702Z:f2fd7682-45a9-47f9-a802-ee0323a08a2f",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000fd40f0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc001786300>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0017862e0>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0013d0540>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Deletes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CC4F23FE193F4C1FB16C204ED434C9F4 Ref B: CHI261140510042 Ref C: 2026-03-13T03:16:52Z",
],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/fbb98992-521d-40e7-b146-c0dfb4a73360",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"],
"Date": [
"Fri, 13 Mar 2026 03:17:01 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Correlation-Request-Id": [
"f2fd7682-45a9-47f9-a802-ee0323a08a2f",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T031702Z:f2fd7682-45a9-47f9-a802-ee0323a08a2f",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000d300d8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc000e024c0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000e02480>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f90300>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Fri, 13 Mar 2026 03:19:28 GMT",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Retry-After": ["10"],
"X-Envoy-Upstream-Service-Time": ["10022"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"8b4fb22e-bc20-46b1-8f98-d4392041161d",
],
"X-Msedge-Ref": [
"Ref A: A9CAA84EC1294F488AB1EBE718FAA146 Ref B: CH1AA2020603009 Ref C: 2026-03-13T03:19:18Z",
],
"Content-Length": ["186"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"51a5e370-92d6-4444-ab52-1b5412da1e41",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c7e2a0d7-ccf1-4903-af7f-e49949aa8449",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T031929Z:8b4fb22e-bc20-46b1-8f98-d4392041161d",
],
"Strict-Transport-Security": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000d300d8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc000e024c0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000e02480>{
msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f90300>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Fri, 13 Mar 2026 03:19:28 GMT",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Retry-After": ["10"],
"X-Envoy-Upstream-Service-Time": ["10022"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"8b4fb22e-bc20-46b1-8f98-d4392041161d",
],
"X-Msedge-Ref": [
"Ref A: A9CAA84EC1294F488AB1EBE718FAA146 Ref B: CH1AA2020603009 Ref C: 2026-03-13T03:19:18Z",
],
"Content-Length": ["186"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"51a5e370-92d6-4444-ab52-1b5412da1e41",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c7e2a0d7-ccf1-4903-af7f-e49949aa8449",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T031929Z:8b4fb22e-bc20-46b1-8f98-d4392041161d",
],
"Strict-Transport-Security": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (5)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: c...full failure pattern: failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 4 | 11.11%4 of 36 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 2 · Mar 13: 4 · Mar 14: 0 · Mar 15: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc0017ea2e8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-f85kxr" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc000d15e00>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000d15de0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000d15dc0>{
msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc0017ea2e8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-f85kxr" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc000d15e00>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000d15de0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000d15dc0>{
msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000da81c8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-bbt9j2" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc000b35120>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000b35100>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000b350e0>{
msg: "failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000da81c8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-bbt9j2" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc000b35120>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000b35100>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc000b350e0>{
msg: "failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc0015623f0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-listcwcr6n" in resourcegroup="ea-list-kd7958" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc001681600>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0016815e0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0016815c0>{
msg: "failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc0015623f0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-listcwcr6n" in resourcegroup="ea-list-kd7958" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc001681600>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0016815e0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc0016815c0>{
msg: "failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb08a0c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredContributing tests (5)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 3 | 8.33%3 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 2 · Mar 7: 1 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 3 | 8.33%3 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 2 · Mar 7: 1 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:35]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:35]: Interrupted by User Contributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4full failure pattern: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4 Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 3 | 8.33%3 of 36 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 1 · Mar 13: 2 · Mar 14: 0 · Mar 15: 0 | INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.005s.
Expected success, but got an error:
<*errors.joinError | 0xc001085770>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc000a12720>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0008a2660>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.005s.
Expected success, but got an error:
<*errors.joinError | 0xc001085770>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc000a12720>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0008a2660>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.009s.
Expected success, but got an error:
<*errors.joinError | 0xc0011582e8>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc000ac67c0>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0001427d0>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.009s.
Expected success, but got an error:
<*errors.joinError | 0xc0011582e8>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc000ac67c0>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0001427d0>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.008s.
Expected success, but got an error:
<*errors.joinError | 0xc000c0f0f8>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc0002fc120>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc000662dd0>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.008s.
Expected success, but got an error:
<*errors.joinError | 0xc000c0f0f8>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc0002fc120>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc000662dd0>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}Contributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create HCP cluster <cluster>: failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url>full failure pattern: failed to create HCP cluster <cluster>: failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url> Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.56%2 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 16 · Mar 3: 16 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
<*fmt.wrapError | 0xc00100b6e0>:
failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8zshf2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-cluster: failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00100b6c0>{
msg: "failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015a6c90>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Msedge-Ref": [
"Ref A: 062CB161D1504BBBBC32E414F7FC2EE0 Ref B: CHI261140513023 Ref C: 2026-03-03T02:04:44Z",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/ef1e3554-21f7-413e-9986-3f2b03675fd0",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"X-Ms-Correlation-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc00100b600>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
<*fmt.wrapError | 0xc00100b6e0>:
failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8zshf2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-cluster: failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00100b6c0>{
msg: "failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015a6c90>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Msedge-Ref": [
"Ref A: 062CB161D1504BBBBC32E414F7FC2EE0 Ref B: CHI261140513023 Ref C: 2026-03-03T02:04:44Z",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/ef1e3554-21f7-413e-9986-3f2b03675fd0",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"X-Ms-Correlation-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc00100b600>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc0009b9060>:
failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation "list-test-cluster-9l52pq" in resourcegroup="cluster-listing-cl569h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009b9040>{
msg: "failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011f5a10>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 4181416C6F604F9FAB3E60A0A746D6B2 Ref B: CHI261140514040 Ref C: 2026-03-03T02:04:45Z",
],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/33f12f27-dfd0-4f86-a6bb-840b8cd332be",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0009b8ee0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc0009b9060>:
failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation "list-test-cluster-9l52pq" in resourcegroup="cluster-listing-cl569h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009b9040>{
msg: "failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011f5a10>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 4181416C6F604F9FAB3E60A0A746D6B2 Ref B: CHI261140514040 Ref C: 2026-03-03T02:04:45Z",
],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/33f12f27-dfd0-4f86-a6bb-840b8cd332be",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0009b8ee0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c0a500>:
failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-gmxvqn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000c0a4e0>{
msg: "failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009c97d0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Msedge-Ref": [
"Ref A: DE0330A94FB84A1AA4EA1642CF2BBBF4 Ref B: CH1AA2020620051 Ref C: 2026-03-03T02:04:35Z",
],
"X-Ms-Correlation-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Tue, 03 Mar 2026 02:04:35 GMT",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b311698-8974-40f6-a94b-ce73951280c0",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["6"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020435Z:60d0c633-2099-4096-9ec5-256574c14354",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc000c0a420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c0a500>:
failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-gmxvqn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000c0a4e0>{
msg: "failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009c97d0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Msedge-Ref": [
"Ref A: DE0330A94FB84A1AA4EA1642CF2BBBF4 Ref B: CH1AA2020620051 Ref C: 2026-03-03T02:04:35Z",
],
"X-Ms-Correlation-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Tue, 03 Mar 2026 02:04:35 GMT",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b311698-8974-40f6-a94b-ce73951280c0",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["6"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020435Z:60d0c633-2099-4096-9ec5-256574c14354",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc000c0a420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (16)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InvalidRequestContent; detail message Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InvalidRequestContent; detail message Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 5.56%2 of 36 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 10 · Mar 13: 10 · Mar 14: 0 · Mar 15: 0 | INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapError | 0xc00061c6e0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-s58clz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00061c680>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000c48660>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Msedge-Ref": [
"Ref A: 464A75CC61A1478A90E29E6DFB49BE37 Ref B: CH1AA2020610029 Ref C: 2026-03-13T01:49:31Z",
],
"Content-Length": ["170"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"aed4189a-5711-491e-8bb6-acfacec34220",
],
"X-Envoy-Upstream-Service-Time": ["286"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T014932Z:5707dfab-8c93-438a-85f8-fe0b471a077a",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/307313a4-b300-4bb0-b030-114e8e644174",
],
"Date": [
"Fri, 13 Mar 2026 01:49:31 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"5707dfab-8c93-438a-85f8-fe0b471a077a",
],
"Strict-Transpo...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapError | 0xc00061c6e0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-s58clz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00061c680>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000c48660>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Msedge-Ref": [
"Ref A: 464A75CC61A1478A90E29E6DFB49BE37 Ref B: CH1AA2020610029 Ref C: 2026-03-13T01:49:31Z",
],
"Content-Length": ["170"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"aed4189a-5711-491e-8bb6-acfacec34220",
],
"X-Envoy-Upstream-Service-Time": ["286"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T014932Z:5707dfab-8c93-438a-85f8-fe0b471a077a",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/307313a4-b300-4bb0-b030-114e8e644174",
],
"Date": [
"Fri, 13 Mar 2026 01:49:31 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"5707dfab-8c93-438a-85f8-fe0b471a077a",
],
"Strict-Transpo...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
<*fmt.wrapError | 0xc000d94240>:
failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-8cnnck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000d94220>{
msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011dc330>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CE27CC750B4F4A1099A8FE01F39FD561 Ref B: CHI261140504029 Ref C: 2026-03-13T01:48:41Z",
],
"Expires": ["-1"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"3a2f44cb-0316-432e-9f20-f948736553c2",
],
"X-Ms-Correlation-Request-Id": [
"e54bd54b-460d-43e4-a17a-c650ba3ec54f",
],
"X-Envoy-Upstream-Service-Time": ["3358"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/26c75988-1220-4415-af03-21c025e4c013",
],
"Date": [
"Fri, 13 Mar 2026 01:48:44 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["170"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T014844Z:e54bd54b-460d-43e4-a17a-c650ba3ec54f",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"P...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
<*fmt.wrapError | 0xc000d94240>:
failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-8cnnck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000d94220>{
msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011dc330>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CE27CC750B4F4A1099A8FE01F39FD561 Ref B: CHI261140504029 Ref C: 2026-03-13T01:48:41Z",
],
"Expires": ["-1"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"3a2f44cb-0316-432e-9f20-f948736553c2",
],
"X-Ms-Correlation-Request-Id": [
"e54bd54b-460d-43e4-a17a-c650ba3ec54f",
],
"X-Envoy-Upstream-Service-Time": ["3358"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/26c75988-1220-4415-af03-21c025e4c013",
],
"Date": [
"Fri, 13 Mar 2026 01:48:44 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["170"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T014844Z:e54bd54b-460d-43e4-a17a-c650ba3ec54f",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"P...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc000a03e00>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-fph99j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a03de0>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015b46f0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Content-Length": ["170"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["2485"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T014759Z:b223bd31-5124-4336-8659-d621923b7581",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"985c3873-8557-481e-b7da-f41abf57b299",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/223eff5f-1b5c-4425-89eb-063d6fc5f956",
],
"X-Ms-Correlation-Request-Id": [
"b223bd31-5124-4336-8659-d621923b7581",
],
"X-Msedge-Ref": [
"Ref A: B9DD73C420794F7A8138A30F859A721A Ref B: CHI261140505042 Ref C: 2026-03-13T01:47:56Z",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc000a03e00>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-fph99j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a03de0>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015b46f0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Content-Length": ["170"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["2485"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260313T014759Z:b223bd31-5124-4336-8659-d621923b7581",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"985c3873-8557-481e-b7da-f41abf57b299",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/223eff5f-1b5c-4425-89eb-063d6fc5f956",
],
"X-Ms-Correlation-Request-Id": [
"b223bd31-5124-4336-8659-d621923b7581",
],
"X-Msedge-Ref": [
"Ref A: B9DD73C420794F7A8138A30F859A721A Ref B: CHI261140505042 Ref C: 2026-03-13T01:47:56Z",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (10)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url>full failure pattern: failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url> Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.56%2 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 3 · Mar 3: 3 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: Unexpected error:
<*fmt.wrapError | 0xc000606320>:
failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-6ds7jn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"customer-rg-6ds7jn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f836e0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020515Z:26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["8"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/b6e73d46-c8c1-4ba8-ab8b-f4bde60961dd",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"X-Msedge-Ref": [
"Ref A: 1BBEAFCFBBD842808141C2559244962B Ref B: CH1AA2020603027 Ref C: 2026-03-03T02:05:15Z",
],
"Date": [
"Tue, 03 Mar 2026 02:05:14 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000606240>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5600"],
"Content-Type": ["application/json"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: Unexpected error:
<*fmt.wrapError | 0xc000606320>:
failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-6ds7jn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"customer-rg-6ds7jn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f836e0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020515Z:26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["8"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/b6e73d46-c8c1-4ba8-ab8b-f4bde60961dd",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"X-Msedge-Ref": [
"Ref A: 1BBEAFCFBBD842808141C2559244962B Ref B: CH1AA2020603027 Ref C: 2026-03-03T02:05:15Z",
],
"Date": [
"Tue, 03 Mar 2026 02:05:14 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000606240>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5600"],
"Content-Type": ["application/json"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000779b60>:
failed starting cluster creation "admin-cred-lifecycle-kdmgl9" in resourcegroup="admin-credential-lifecycle-test-h54zg6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-kdmgl9\" in resourcegroup=\"admin-credential-lifecycle-test-h54zg6\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00108e930>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["197"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2997"],
"X-Ms-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: E637E21304954189BBCAF67B4EED414D Ref B: CHI261140505062 Ref C: 2026-03-03T02:04:45Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:45 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Correlation-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c3da556d-8c33-46cc-b6a1-3095345a88de",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:ad250214-8157-43ca-8b84-494835990ab3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000779aa0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-ar...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000779b60>:
failed starting cluster creation "admin-cred-lifecycle-kdmgl9" in resourcegroup="admin-credential-lifecycle-test-h54zg6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-kdmgl9\" in resourcegroup=\"admin-credential-lifecycle-test-h54zg6\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00108e930>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["197"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2997"],
"X-Ms-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: E637E21304954189BBCAF67B4EED414D Ref B: CHI261140505062 Ref C: 2026-03-03T02:04:45Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:45 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Correlation-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c3da556d-8c33-46cc-b6a1-3095345a88de",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:ad250214-8157-43ca-8b84-494835990ab3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000779aa0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-ar...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
<*fmt.wrapError | 0xc00031a120>:
failed starting cluster creation "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-24xr77": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-24xr77\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00123b500>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Content-Length": ["0"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"Date": [
"Tue, 03 Mar 2026 02:04:32 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c9fe35d6-8282-4a2e-9afa-f6e5aedeb184",
],
"X-Ms-Correlation-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020433Z:cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 01A1E278810D41A394B4755A4302B8F1 Ref B: CHI261140507062 Ref C: 2026-03-03T02:04:32Z",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
},
Body: <*exported.nopClosingBytesReader | 0xc00031a000>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5568"],
"Con...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
<*fmt.wrapError | 0xc00031a120>:
failed starting cluster creation "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-24xr77": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-24xr77\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00123b500>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Content-Length": ["0"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"Date": [
"Tue, 03 Mar 2026 02:04:32 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c9fe35d6-8282-4a2e-9afa-f6e5aedeb184",
],
"X-Ms-Correlation-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020433Z:cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 01A1E278810D41A394B4755A4302B8F1 Ref B: CHI261140507062 Ref C: 2026-03-03T02:04:32Z",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
},
Body: <*exported.nopClosingBytesReader | 0xc00031a000>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5568"],
"Con...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (3)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
RESPONSE 502: 502 Bad Gatewayfull failure pattern: RESPONSE 502: 502 Bad Gateway Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.56%2 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 1 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc000736630>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["21"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Ms-Correlation-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadaeast/ba27f757-9a9b-4484-a280-cd559d08fd5d",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T020343Z:76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Msedge-Ref": [
"Ref A: C43A14F7592A4B0EB9887E19E49E7EC9 Ref B: CH1AA2020620025 Ref C: 2026-03-03T02:03:42Z",
],
"Date": [
"Tue, 03 Mar 2026 02:03:42 GMT",
],
"Expires": ["-1"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc001326a80>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc000736630>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["21"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Ms-Correlation-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadaeast/ba27f757-9a9b-4484-a280-cd559d08fd5d",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T020343Z:76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Msedge-Ref": [
"Ref A: C43A14F7592A4B0EB9887E19E49E7EC9 Ref B: CH1AA2020620025 Ref C: 2026-03-03T02:03:42Z",
],
"Date": [
"Tue, 03 Mar 2026 02:03:42 GMT",
],
"Expires": ["-1"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc001326a80>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc0008dc570>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T020335Z:51aa9d18-066d-4e9d-868b-fee847027541",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 823A8F27C87B4E83AAB93890B6222AC2 Ref B: CHI261140505042 Ref C: 2026-03-02T02:03:35Z",
],
"Date": [
"Mon, 02 Mar 2026 02:03:35 GMT",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/4c8da580-69cd-47c3-bdbe-fe9e1d9ffb7e",
],
"X-Ms-Correlation-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
},
Body: <*exported.nopClosingBytesReader | 0xc00093f760>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc0008dc570>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T020335Z:51aa9d18-066d-4e9d-868b-fee847027541",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 823A8F27C87B4E83AAB93890B6222AC2 Ref B: CHI261140505042 Ref C: 2026-03-02T02:03:35Z",
],
"Date": [
"Mon, 02 Mar 2026 02:03:35 GMT",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/4c8da580-69cd-47c3-bdbe-fe9e1d9ffb7e",
],
"X-Ms-Correlation-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
},
Body: <*exported.nopClosingBytesReader | 0xc00093f760>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Version .* (doesn't exist|is disabled)full failure pattern: Version .* (doesn't exist|is disabled) Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 5.56%2 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 1 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000a11da0>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-zg9tr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a11d80>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00133b020>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 99A77695EADC427AA082D3ED564473BF Ref B: CHI261140504025 Ref C: 2026-03-03T02:04:56Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:56 GMT",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/74f411c3-f8b4-468f-98b4-9b6d25fde2f7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020456Z:ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["10"],
},
Body: <*exported.nopClosingBytesReader | 0xc000a11cc0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc00133b0b0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000a11da0>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-zg9tr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a11d80>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00133b020>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 99A77695EADC427AA082D3ED564473BF Ref B: CHI261140504025 Ref C: 2026-03-03T02:04:56Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:56 GMT",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/74f411c3-f8b4-468f-98b4-9b6d25fde2f7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020456Z:ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["10"],
},
Body: <*exported.nopClosingBytesReader | 0xc000a11cc0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc00133b0b0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000d82500>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-xg8g49": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000d824e0>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001067a40>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/43dc45c5-178f-4ba6-9c89-26234160bbce",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260302T020435Z:e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Msedge-Ref": [
"Ref A: 9400E1E30F6D42FB9824BB4364776479 Ref B: CHI261140508040 Ref C: 2026-03-02T02:04:35Z",
],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"X-Envoy-Upstream-Service-Time": ["9"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 02 Mar 2026 02:04:35 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d82420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc001067ad0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000d82500>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-xg8g49": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000d824e0>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001067a40>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/43dc45c5-178f-4ba6-9c89-26234160bbce",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260302T020435Z:e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Msedge-Ref": [
"Ref A: 9400E1E30F6D42FB9824BB4364776479 Ref B: CHI261140508040 Ref C: 2026-03-02T02:04:35Z",
],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"X-Envoy-Upstream-Service-Time": ["9"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 02 Mar 2026 02:04:35 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d82420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc001067ad0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Test Panickedfull failure pattern: Test Panicked Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 2.78%1 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 21 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e89500?, {0x7f128a29bfc0?, 0xc000e68cc0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000e55320, {0x7f128a29bfc0, 0xc000e68cc0}, {0x77d9d2e, 0x7}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func19.2({0x7f128a29bfc0, 0xc000e68cc0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:58 +0x155
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e68cc0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 90
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e89500?, {0x7f128a29bfc0?, 0xc000e68cc0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000e55320, {0x7f128a29bfc0, 0xc000e68cc0}, {0x77d9d2e, 0x7}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func19.2({0x7f128a29bfc0, 0xc000e68cc0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:58 +0x155
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e68cc0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 90
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c1e6c0?, {0x7f1028100d28?, 0xc000e04360?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000826fc0, {0x7f1028100d28, 0xc000e04360}, {0x781d01f, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func18.2({0x7f1028100d28, 0xc000e04360})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:67 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e04360?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 109
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c1e6c0?, {0x7f1028100d28?, 0xc000e04360?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000826fc0, {0x7f1028100d28, 0xc000e04360}, {0x781d01f, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func18.2({0x7f1028100d28, 0xc000e04360})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:67 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e04360?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 109
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000b0ef40?, {0x7fd9c04c7f98?, 0xc000bea990?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000969c20, {0x7fd9c04c7f98, 0xc000bea990}, {0x77f1edf, 0xc}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func9.2({0x7fd9c04c7f98, 0xc000bea990})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:54 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000bea990?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 94
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000b0ef40?, {0x7fd9c04c7f98?, 0xc000bea990?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000969c20, {0x7fd9c04c7f98, 0xc000bea990}, {0x77f1edf, 0xc}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func9.2({0x7fd9c04c7f98, 0xc000bea990})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:54 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000bea990?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 94
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test PanickedContributing tests (21)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: ServiceUnavailable; detail message Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installa...full failure pattern: ERROR CODE: ServiceUnavailable; detail message Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 2.78%1 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 14 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc000f92120>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-f2swr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f92100>{
msg: "failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e00c30>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Sat, 07 Mar 2026 14:46:39 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["5434"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"X-Msedge-Ref": [
"Ref A: 26E1CBDA73BD43A79BC0F8BDEBA1A221 Ref B: CHI261140511060 Ref C: 2026-03-07T14:46:33Z",
],
"Content-Length": ["257"],
"X-Ms-Failure-Cause": ["service"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"1778cbf7-6dd3-4e0d-8967-ddcd4fa5ce20",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144639Z:7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Operation-Identifier": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc000f92120>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-f2swr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f92100>{
msg: "failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e00c30>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Sat, 07 Mar 2026 14:46:39 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["5434"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"X-Msedge-Ref": [
"Ref A: 26E1CBDA73BD43A79BC0F8BDEBA1A221 Ref B: CHI261140511060 Ref C: 2026-03-07T14:46:33Z",
],
"Content-Length": ["257"],
"X-Ms-Failure-Cause": ["service"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"1778cbf7-6dd3-4e0d-8967-ddcd4fa5ce20",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144639Z:7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Operation-Identifier": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapError | 0xc000804440>:
failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-ztzxxw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000804420>{
msg: "failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0010f4180>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Expires": ["-1"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"463c4396-e0a8-4c68-9a68-baa42d6b95ec",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7F2143198592408EBDD587AE8FD44441 Ref B: CHI261140501023 Ref C: 2026-03-07T14:47:35Z",
],
"Date": [
"Sat, 07 Mar 2026 14:47:43 GMT",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Correlation-Request-Id": [
"3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144743Z:3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
"X-Envoy-Upstream-Service-Time": ["8182"],
"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapError | 0xc000804440>:
failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-ztzxxw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000804420>{
msg: "failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0010f4180>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Expires": ["-1"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"463c4396-e0a8-4c68-9a68-baa42d6b95ec",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7F2143198592408EBDD587AE8FD44441 Ref B: CHI261140501023 Ref C: 2026-03-07T14:47:35Z",
],
"Date": [
"Sat, 07 Mar 2026 14:47:43 GMT",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Correlation-Request-Id": [
"3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144743Z:3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
"X-Envoy-Upstream-Service-Time": ["8182"],
"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc0013e2360>:
failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-dth5xj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-tags-cluster: failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e2340>{
msg: "failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00110a570>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sat, 07 Mar 2026 14:47:09 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/7811f68c-d0c6-4229-bad2-4fa1629e67b7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Request-Id": [
"d8d9e333-730f-490b-9b31-7135ff41c759",
],
"X-Envoy-Upstream-Service-Time": ["2898"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144709Z:a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc0013e2360>:
failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-dth5xj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-tags-cluster: failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e2340>{
msg: "failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00110a570>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sat, 07 Mar 2026 14:47:09 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/7811f68c-d0c6-4229-bad2-4fa1629e67b7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Request-Id": [
"d8d9e333-730f-490b-9b31-7135ff41c759",
],
"X-Envoy-Upstream-Service-Time": ["2898"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144709Z:a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (14)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Should receive valid HTTP status code from authorized IPfull failure pattern: Should receive valid HTTP status code from authorized IP Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 2.78%1 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Unauthorizedfull failure pattern: Unauthorized Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.78%1 of 36 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 1 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:222]: Timed out after 300.007s.
Expected success, but got an error:
<*errors.StatusError | 0xc001083400>:
Unauthorized
{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "Unauthorized",
Reason: "Unauthorized",
Details: nil,
Code: 401,
},
}
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:222]: Timed out after 300.007s.
Expected success, but got an error:
<*errors.StatusError | 0xc001083400>:
Unauthorized
{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "Unauthorized",
Reason: "Unauthorized",
Details: nil,
Code: 401,
},
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Pr...full failure pattern: cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 2.78%1 of 36 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 1 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
<*errors.errorString | 0xc000efdf00>:
cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
{
s: "cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
<*errors.errorString | 0xc000efdf00>:
cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
{
s: "cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
subscription state not foundfull failure pattern: subscription state not found Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 2.78%1 of 36 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.000s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000482ec0>:
subscription state not found
{
s: "subscription state not found",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.000s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000482ec0>:
subscription state not found
{
s: "subscription state not found",
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Environment: PROD
E2E Jobs
64
Success Rate
59.38%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.61.29% (38/62)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 89.47% | 38 | prod/parallel | Customer should be able to list HCP clusters without node pools at both subscription and resource group levels | |
| 90.91% | 11 | prod/parallel | Control plane automated z-stream upgrade with candidate channel should perform an automated control plane z-stream upgrade using the candidate channel | |
| 92.11% | 38 | prod/parallel | Authorized CIDRs Connectivity should allow API access only from authorized VM IP | |
| 94.74% | 38 | prod/parallel | Customer should be able to create a cluster with an external auth config and get the external auth config | |
| 94.74% | 38 | prod/parallel | Customer should be able to create an HCP cluster |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Interrupted by Userfull failure pattern: Interrupted by User Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days | e2e | 11 | 17.19%11 of 64 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days | Show trend detailsMar 2: 1 · Mar 3: 12 · Mar 4: 16 · Mar 5: 2 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 1 · Mar 11: 2 · Mar 12: 1 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [:0]: Interrupted by User fail [:0]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:48]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:48]: Interrupted by User Contributing tests (17)
Affected runs (11)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | e2e | 7 | 10.94%7 of 64 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | Show trend detailsMar 2: 1 · Mar 3: 5 · Mar 4: 1 · Mar 5: 2 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)o complete creation")
> _, err = poller2.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000d270b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 48
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:135 @ 03/05/26 07:05:43.617
"ts"="2026-03-05 07:05:43.617714" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 07:05:43.617781" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-kwnth4" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:43.829234" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-kwnth4" "resourceGroup"=""
"ts"="2026-03-05 07:05:45.615032" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-4clpsq" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:45.785098" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-4clpsq" "resourceGroup"=""
"ts"="2026-03-05 07:05:47.508736" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508844" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508918" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 07:05:47.509851" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-108"
"ts"="2026-03-05 07:05:47.509863" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-124"
"ts"="2026-03-05 07:05:47.509936" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:47.509891" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-120"
"ts"="2026-03-05 07:05:47.705727" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-05 07:05:47.837833" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster2-4clpsq"
"ts"="2026-03-05 07:05:47.842262" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.843623" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.971538" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="msi-deployment-120"
"ts"="2026-03-05 07:05:47.971609" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="msi-deployment-124"
"ts"="2026-03-05 07:05:47.979881" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.993788" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-05 07:05:48.130080" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster-kwnth4"
"ts"="2026-03-05 07:05:48.635410" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="msi-deployment-108"
"ts"="2026-03-05 07:05:48.772313" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 07:05:48.772502" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 07:05:48.772619" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392780" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392812" "level"=0 "msg"="deleting resource group" "resourceGroup"="customer-rg-hxctbd"
Command Error: signal: killed
Deserializaion Error: no output from command
o complete creation")
> _, err = poller2.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000d270b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 48
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:135 @ 03/05/26 07:05:43.617
"ts"="2026-03-05 07:05:43.617714" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 07:05:43.617781" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-kwnth4" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:43.829234" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-kwnth4" "resourceGroup"=""
"ts"="2026-03-05 07:05:45.615032" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-4clpsq" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:45.785098" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-4clpsq" "resourceGroup"=""
"ts"="2026-03-05 07:05:47.508736" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508844" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508918" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 07:05:47.509851" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-108"
"ts"="2026-03-05 07:05:47.509863" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-124"
"ts"="2026-03-05 07:05:47.509936" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:47.509891" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-120"
"ts"="2026-03-05 07:05:47.705727" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-05 07:05:47.837833" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster2-4clpsq"
"ts"="2026-03-05 07:05:47.842262" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.843623" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.971538" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="msi-deployment-120"
"ts"="2026-03-05 07:05:47.971609" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="msi-deployment-124"
"ts"="2026-03-05 07:05:47.979881" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.993788" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-05 07:05:48.130080" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster-kwnth4"
"ts"="2026-03-05 07:05:48.635410" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="msi-deployment-108"
"ts"="2026-03-05 07:05:48.772313" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 07:05:48.772502" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 07:05:48.772619" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392780" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392812" "level"=0 "msg"="deleting resource group" "resourceGroup"="customer-rg-hxctbd"
Command Error: signal: killed
Deserializaion Error: no output from command.(*clientConnReadLoop).run(0xc000383fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000383f60 sp=0xc000383e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001550380)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000383fc8 sp=0xc000383f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000383fe0 sp=0xc000383fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000383fe8 sp=0xc000383fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 95
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
goroutine 1155 gp=0xc001550a80 m=nil [IO wait]:
runtime.gopark(0xc0008a3600?, 0xc000e11758?, 0x6c?, 0xa0?, 0xb?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000e11720 sp=0xc000e11700 pc=0x2abd28e
runtime.netpollblock(0x2b26d58?, 0x2a49046?, 0x0?)
/usr/local/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000e11758 sp=0xc000e11720 pc=0x2a7ce97
internal/poll.runtime_pollWait(0x7f281ec6ca00, 0x72)
/usr/local/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000e11778 sp=0xc000e11758 pc=0x2abbb25
internal/poll.(*pollDesc).wait(0xc000251d80?, 0xc00148c000?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000e117a0 sp=0xc000e11778 pc=0x2b49a87
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000251d80, {0xc00148c000, 0x1300, 0x1300})
/usr/local/go/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc000e11838 sp=0xc000e117a0 pc=0x2b4aeb9
net.(*netFD).Read(0xc000251d80, {0xc00148c000?, 0xc00148c000?, 0x5?})
/usr/local/go/src/net/fd_posix.go:68 +0x25 fp=0xc000e11880 sp=0xc000e11838 pc=0x2cdf185
net.(*conn).Read(0xc0009360c8, {0xc00148c000?, 0x7f286585c210?, 0x7f28658535c0?})
/usr/local/go/src/net/net.go:196 +0x45 fp=0xc000e118c8 sp=0xc000e11880 pc=0x2cf1225
crypto/tls.(*atLeastReader).Read(0xc000013b60, {0xc00148c000?, 0x12fb?, 0xe?})
/usr/local/go/src/crypto/tls/conn.go:819 +0x3b fp=0xc000e11910 sp=0xc000e118c8 pc=0x2d5cadb
bytes.(*Buffer).ReadFrom(0xc00095d428, {0x8173120, 0xc000013b60})
/usr/local/go/src/bytes/buffer.go:217 +0x98 fp=0xc000e11968 sp=0xc000e11910 pc=0x2b87a38
crypto/tls.(*Conn).readFromUntil(0xc00095d188, {0x8173b20, 0xc0009360c8}, 0xc000e119d0?)
/usr/local/go/src/crypto/tls/conn.go:841 +0xde fp=0xc000e119a0 sp=0xc000e11968 pc=0x2d5ccbe
crypto/tls.(*Conn).readRecordOrCCS(0xc00095d188, 0x0)
/usr/local/go/src/crypto/tls/conn.go:630 +0x3db fp=0xc000e11c18 sp=0xc000e119a0 pc=0x2d59d3b
crypto/tls.(*Conn).readRecord(...)
/usr/local/go/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc00095d188, {0xc001478000, 0x1000, 0x319b220?})
/usr/local/go/src/crypto/tls/conn.go:1397 +0x145 fp=0xc000e11c80 sp=0xc000e11c18 pc=0x2d60625
bufio.(*Reader).Read(0xc000e81440, {0xc00154e2e4, 0x9, 0x2a409ab?})
/usr/local/go/src/bufio/bufio.go:245 +0x197 fp=0xc000e11cb8 sp=0xc000e11c80 pc=0x2c22617
io.ReadAtLeast({0x8172700, 0xc000e81440}, {0xc00154e2e4, 0x9, 0x9}, 0x9)
/usr/local/go/src/io/io.go:335 +0x8e fp=0xc000e11d00 sp=0xc000e11cb8 pc=0x2b17aee
io.ReadFull(...)
/usr/local/go/src/io/io.go:354
golang.org/x/net/http2.readFrameHeader({0xc00154e2e4, 0x9, 0x6cd24e0?}, {0x8172700?, 0xc000e81440?})
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:242 +0x65 fp=0xc000e11d50 sp=0xc000e11d00 pc=0x31929c5
golang.org/x/net/http2.(*Framer).ReadFrameHeader(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:505 +0x6b fp=0xc000e11dd8 sp=0xc000e11d50 pc=0x319358b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:564 +0x18 fp=0xc000e11e18 sp=0xc000e11dd8 pc=0x3193cf8
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc000e11fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000e11f60 sp=0xc000e11e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001551c00)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000e11fc8 sp=0xc000e11f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000e11fe0 sp=0xc000e11fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e11fe8 sp=0xc000e11fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 1154
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
rax 0xfffffffffffffffc
rbx 0x5
rcx 0x2a3ce0e
rdx 0x80
rdi 0x5
rsi 0x7ffff925c09c
rbp 0x7ffff925c050
rsp 0x7ffff925c008
r8 0x0
r9 0x0
r10 0x11ba
r11 0x246
r12 0x7ffff925c0e0
r13 0x1
r14 0xb2ed360
r15 0x5
rip 0x2a3ce0e
rflags 0x246
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from command
.(*clientConnReadLoop).run(0xc000383fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000383f60 sp=0xc000383e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001550380)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000383fc8 sp=0xc000383f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000383fe0 sp=0xc000383fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000383fe8 sp=0xc000383fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 95
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
goroutine 1155 gp=0xc001550a80 m=nil [IO wait]:
runtime.gopark(0xc0008a3600?, 0xc000e11758?, 0x6c?, 0xa0?, 0xb?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000e11720 sp=0xc000e11700 pc=0x2abd28e
runtime.netpollblock(0x2b26d58?, 0x2a49046?, 0x0?)
/usr/local/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000e11758 sp=0xc000e11720 pc=0x2a7ce97
internal/poll.runtime_pollWait(0x7f281ec6ca00, 0x72)
/usr/local/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000e11778 sp=0xc000e11758 pc=0x2abbb25
internal/poll.(*pollDesc).wait(0xc000251d80?, 0xc00148c000?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000e117a0 sp=0xc000e11778 pc=0x2b49a87
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000251d80, {0xc00148c000, 0x1300, 0x1300})
/usr/local/go/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc000e11838 sp=0xc000e117a0 pc=0x2b4aeb9
net.(*netFD).Read(0xc000251d80, {0xc00148c000?, 0xc00148c000?, 0x5?})
/usr/local/go/src/net/fd_posix.go:68 +0x25 fp=0xc000e11880 sp=0xc000e11838 pc=0x2cdf185
net.(*conn).Read(0xc0009360c8, {0xc00148c000?, 0x7f286585c210?, 0x7f28658535c0?})
/usr/local/go/src/net/net.go:196 +0x45 fp=0xc000e118c8 sp=0xc000e11880 pc=0x2cf1225
crypto/tls.(*atLeastReader).Read(0xc000013b60, {0xc00148c000?, 0x12fb?, 0xe?})
/usr/local/go/src/crypto/tls/conn.go:819 +0x3b fp=0xc000e11910 sp=0xc000e118c8 pc=0x2d5cadb
bytes.(*Buffer).ReadFrom(0xc00095d428, {0x8173120, 0xc000013b60})
/usr/local/go/src/bytes/buffer.go:217 +0x98 fp=0xc000e11968 sp=0xc000e11910 pc=0x2b87a38
crypto/tls.(*Conn).readFromUntil(0xc00095d188, {0x8173b20, 0xc0009360c8}, 0xc000e119d0?)
/usr/local/go/src/crypto/tls/conn.go:841 +0xde fp=0xc000e119a0 sp=0xc000e11968 pc=0x2d5ccbe
crypto/tls.(*Conn).readRecordOrCCS(0xc00095d188, 0x0)
/usr/local/go/src/crypto/tls/conn.go:630 +0x3db fp=0xc000e11c18 sp=0xc000e119a0 pc=0x2d59d3b
crypto/tls.(*Conn).readRecord(...)
/usr/local/go/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc00095d188, {0xc001478000, 0x1000, 0x319b220?})
/usr/local/go/src/crypto/tls/conn.go:1397 +0x145 fp=0xc000e11c80 sp=0xc000e11c18 pc=0x2d60625
bufio.(*Reader).Read(0xc000e81440, {0xc00154e2e4, 0x9, 0x2a409ab?})
/usr/local/go/src/bufio/bufio.go:245 +0x197 fp=0xc000e11cb8 sp=0xc000e11c80 pc=0x2c22617
io.ReadAtLeast({0x8172700, 0xc000e81440}, {0xc00154e2e4, 0x9, 0x9}, 0x9)
/usr/local/go/src/io/io.go:335 +0x8e fp=0xc000e11d00 sp=0xc000e11cb8 pc=0x2b17aee
io.ReadFull(...)
/usr/local/go/src/io/io.go:354
golang.org/x/net/http2.readFrameHeader({0xc00154e2e4, 0x9, 0x6cd24e0?}, {0x8172700?, 0xc000e81440?})
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:242 +0x65 fp=0xc000e11d50 sp=0xc000e11d00 pc=0x31929c5
golang.org/x/net/http2.(*Framer).ReadFrameHeader(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:505 +0x6b fp=0xc000e11dd8 sp=0xc000e11d50 pc=0x319358b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:564 +0x18 fp=0xc000e11e18 sp=0xc000e11dd8 pc=0x3193cf8
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc000e11fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000e11f60 sp=0xc000e11e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001551c00)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000e11fc8 sp=0xc000e11f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000e11fe0 sp=0xc000e11fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e11fe8 sp=0xc000e11fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 1154
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
rax 0xfffffffffffffffc
rbx 0x5
rcx 0x2a3ce0e
rdx 0x80
rdi 0x5
rsi 0x7ffff925c09c
rbp 0x7ffff925c050
rsp 0x7ffff925c008
r8 0x0
r9 0x0
r10 0x11ba
r11 0x246
r12 0x7ffff925c0e0
r13 0x1
r14 0xb2ed360
r15 0x5
rip 0x2a3ce0e
rflags 0x246
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from commandp=0xc000cf3900 sp=0xc000cf38e0 pc=0x2abd28e
runtime.selectgo(0xc000cf49a0, 0xc000cf3cf4, 0x0?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000cf3a40 sp=0xc000cf3900 pc=0x2a98137
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode(_, {0x42, 0x4, {0x78ef949, 0x41}, 0xc000d855e0, {{0x968cd56, 0x4b}, 0x7a, {0x0, ...}, ...}, ...}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:923 +0xf65 fp=0xc000cf4d38 sp=0xc000cf3a40 pc=0x2f00005
github.com/onsi/ginkgo/v2/internal.(*group).attemptSpec(0xc000cf6b98, 0x1, {{0xc000a9ea88?, 0xc000598bc0?, 0x1?}, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:199 +0xbd3 fp=0xc000cf5d58 sp=0xc000cf4d38 pc=0x2ee5453
github.com/onsi/ginkgo/v2/internal.(*group).run(0xc000cf6b98, {0xc000159100?, 0x0?, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:349 +0x905 fp=0xc000cf6960 sp=0xc000cf5d58 pc=0x2ee79e5
github.com/onsi/ginkgo/v2/internal.(*Suite).runSpecs(0xc00085d508, {0x0, 0x0}, {0xb319ac0, 0x0, 0x0}, {0xc00007a064, 0x2a}, 0x0, {0xc0001590e0, ...})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496 +0xa9b fp=0xc000cf6e10 sp=0xc000cf6960 pc=0x2efb4db
github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a064, 0x2a}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68 +0x3c5 fp=0xc000cf6eb8 sp=0xc000cf6e10 pc=0x2f02845
github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2a4ca65?, 0xc000302300?})
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/ginkgo/util.go:85 +0x2ba fp=0xc000cf7b88 sp=0xc000cf6eb8 pc=0x521c71a
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x820bbb8, 0xc000b9f0e0}, 0xc000861680, 0x1)
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:596 +0xee fp=0xc000cf7c30 sp=0xc000cf7b88 pc=0x5212a8e
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:237 +0x196 fp=0xc000cf7fe0 sp=0xc000cf7c30 pc=0x520e816
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000cf7fe8 sp=0xc000cf7fe0 pc=0x2ac5921
created by github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:230 +0x1e5
goroutine 86 gp=0xc000b32e00 m=nil [select, 2 minutes]:
runtime.gopark(0xc000b3d868?, 0x2?, 0xc8?, 0x2d?, 0xc000b3d834?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000b3d6b8 sp=0xc000b3d698 pc=0x2abd28e
runtime.selectgo(0xc000b3d868, 0xc000b3d830, 0x816e580?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000b3d7f8 sp=0xc000b3d6b8 pc=0x2a98137
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).AssignIdentityContainers(0xc0008ae120, {0x7f0b68c01c60, 0xc000811dd0}, 0x1, 0xdf8475800)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/identities_helper.go:271 +0x218 fp=0xc000b3d8e0 sp=0xc000b3d7f8 pc=0x4e997f8
github.com/Azure/ARO-HCP/test/e2e.init.func23.3({0x7f0b68c01c60, 0xc000811dd0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:135 +0x6a fp=0xc000b3df58 sp=0xc000b3d8e0 pc=0x501aaea
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000811dd0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e fp=0xc000b3df88 sp=0xc000b3df58 pc=0x2eed25e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc000b3dfe0 sp=0xc000b3df88 pc=0x2f0197b
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b3dfe8 sp=0xc000b3dfe0 pc=0x2ac5921
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 83
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
rax 0xca
rbx 0x0
rcx 0x2ac7743
rdx 0x0
rdi 0xb2ef450
rsi 0x80
rbp 0x7fff3f6424d0
rsp 0x7fff3f642488
r8 0x0
r9 0x0
r10 0x0
r11 0x286
r12 0x2
r13 0x1
r14 0xb2ed360
r15 0x7
rip 0x2ac7741
rflags 0x286
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from command
p=0xc000cf3900 sp=0xc000cf38e0 pc=0x2abd28e
runtime.selectgo(0xc000cf49a0, 0xc000cf3cf4, 0x0?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000cf3a40 sp=0xc000cf3900 pc=0x2a98137
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode(_, {0x42, 0x4, {0x78ef949, 0x41}, 0xc000d855e0, {{0x968cd56, 0x4b}, 0x7a, {0x0, ...}, ...}, ...}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:923 +0xf65 fp=0xc000cf4d38 sp=0xc000cf3a40 pc=0x2f00005
github.com/onsi/ginkgo/v2/internal.(*group).attemptSpec(0xc000cf6b98, 0x1, {{0xc000a9ea88?, 0xc000598bc0?, 0x1?}, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:199 +0xbd3 fp=0xc000cf5d58 sp=0xc000cf4d38 pc=0x2ee5453
github.com/onsi/ginkgo/v2/internal.(*group).run(0xc000cf6b98, {0xc000159100?, 0x0?, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:349 +0x905 fp=0xc000cf6960 sp=0xc000cf5d58 pc=0x2ee79e5
github.com/onsi/ginkgo/v2/internal.(*Suite).runSpecs(0xc00085d508, {0x0, 0x0}, {0xb319ac0, 0x0, 0x0}, {0xc00007a064, 0x2a}, 0x0, {0xc0001590e0, ...})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496 +0xa9b fp=0xc000cf6e10 sp=0xc000cf6960 pc=0x2efb4db
github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a064, 0x2a}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68 +0x3c5 fp=0xc000cf6eb8 sp=0xc000cf6e10 pc=0x2f02845
github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2a4ca65?, 0xc000302300?})
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/ginkgo/util.go:85 +0x2ba fp=0xc000cf7b88 sp=0xc000cf6eb8 pc=0x521c71a
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x820bbb8, 0xc000b9f0e0}, 0xc000861680, 0x1)
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:596 +0xee fp=0xc000cf7c30 sp=0xc000cf7b88 pc=0x5212a8e
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:237 +0x196 fp=0xc000cf7fe0 sp=0xc000cf7c30 pc=0x520e816
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000cf7fe8 sp=0xc000cf7fe0 pc=0x2ac5921
created by github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:230 +0x1e5
goroutine 86 gp=0xc000b32e00 m=nil [select, 2 minutes]:
runtime.gopark(0xc000b3d868?, 0x2?, 0xc8?, 0x2d?, 0xc000b3d834?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000b3d6b8 sp=0xc000b3d698 pc=0x2abd28e
runtime.selectgo(0xc000b3d868, 0xc000b3d830, 0x816e580?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000b3d7f8 sp=0xc000b3d6b8 pc=0x2a98137
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).AssignIdentityContainers(0xc0008ae120, {0x7f0b68c01c60, 0xc000811dd0}, 0x1, 0xdf8475800)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/identities_helper.go:271 +0x218 fp=0xc000b3d8e0 sp=0xc000b3d7f8 pc=0x4e997f8
github.com/Azure/ARO-HCP/test/e2e.init.func23.3({0x7f0b68c01c60, 0xc000811dd0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:135 +0x6a fp=0xc000b3df58 sp=0xc000b3d8e0 pc=0x501aaea
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000811dd0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e fp=0xc000b3df88 sp=0xc000b3df58 pc=0x2eed25e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc000b3dfe0 sp=0xc000b3df88 pc=0x2f0197b
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b3dfe8 sp=0xc000b3dfe0 pc=0x2ac5921
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 83
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
rax 0xca
rbx 0x0
rcx 0x2ac7743
rdx 0x0
rdi 0xb2ef450
rsi 0x80
rbp 0x7fff3f6424d0
rsp 0x7fff3f642488
r8 0x0
r9 0x0
r10 0x0
r11 0x286
r12 0x2
r13 0x1
r14 0xb2ed360
r15 0x7
rip 0x2ac7741
rflags 0x286
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from commandContributing tests (4)
Affected runs (7)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | e2e | 6 | 9.38%6 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | Show trend detailsMar 2: 0 · Mar 3: 21 · Mar 4: 0 · Mar 5: 5 · Mar 6: 0 · Mar 7: 2 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapErrors | 0xc001512510>:
failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-7p9vzj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded
{
msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<*fmt.wrapErrors | 0xc0015124e0>{
msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapErrors | 0xc001512510>:
failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-7p9vzj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded
{
msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<*fmt.wrapErrors | 0xc0015124e0>{
msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014942d0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-pf6t7j" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<*fmt.wrapErrors | 0xc0014942a0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014942d0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-pf6t7j" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<*fmt.wrapErrors | 0xc0014942a0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc000e4e540>:
failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster="list-test-cluster-jfhd8m" in resourcegroup="cluster-listing-dtc5mn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<*fmt.wrapErrors | 0xc000e4e510>{
msg: "failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc000e4e540>:
failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster="list-test-cluster-jfhd8m" in resourcegroup="cluster-listing-dtc5mn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<*fmt.wrapErrors | 0xc000e4e510>{
msg: "failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (15)
Affected runs (6)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | e2e | 4 | 6.25%4 of 64 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | Show trend detailsMar 2: 8 · Mar 3: 4 · Mar 4: 5 · Mar 5: 7 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc0014cc990>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-mbd9lr" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001298900>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr",
},
<*fmt.wrapError | 0xc000dce820>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc0014cc990>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-mbd9lr" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001298900>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr",
},
<*fmt.wrapError | 0xc000dce820>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000ef68d0>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool="np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-sgkhjw" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0004deee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw",
},
<*fmt.wrapError | 0xc000517520>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000ef68d0>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool="np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-sgkhjw" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0004deee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw",
},
<*fmt.wrapError | 0xc000517520>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: Unexpected error:
<*fmt.wrapErrors | 0xc00137f290>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-hlwxtl" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00068dd20>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl",
},
<*fmt.wrapError | 0xc000d26be0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: Unexpected error:
<*fmt.wrapErrors | 0xc00137f290>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-hlwxtl" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00068dd20>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl",
},
<*fmt.wrapError | 0xc000d26be0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredContributing tests (9)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateOrUpdateExternalAuthAndWait timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateOrUpdateExternalAuthAndWait timed out after <minutes> minutes; context deadline exceeded Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | e2e | 4 | 6.25%4 of 64 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 4 days | Show trend detailsMar 2: 1 · Mar 3: 1 · Mar 4: 1 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000877800>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-dzsdxm" for cluster="ea-listxfk7fg" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-dzsdxm\" for cluster=\"ea-listxfk7fg\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0008746a0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000877800>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-dzsdxm" for cluster="ea-listxfk7fg" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-dzsdxm\" for cluster=\"ea-listxfk7fg\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0008746a0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc001057380>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-8crjbf" for cluster="ea-listr26d5r" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-8crjbf\" for cluster=\"ea-listr26d5r\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000717760>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc001057380>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-8crjbf" for cluster="ea-listr26d5r" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-8crjbf\" for cluster=\"ea-listr26d5r\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000717760>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000eccd20>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-ls8jkz" for cluster="ea-listdwzhrk" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-ls8jkz\" for cluster=\"ea-listdwzhrk\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00083abf0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000eccd20>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-ls8jkz" for cluster="ea-listdwzhrk" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-ls8jkz\" for cluster=\"ea-listdwzhrk\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00083abf0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 3 | 4.69%3 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 2 · Mar 4: 0 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.145s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.145s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.006s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.006s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot create resource while parent resource is provisioning; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot create resource while parent resource is provisioning; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | e2e | 3 | 4.69%3 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 1 · Mar 10: 1 · Mar 11: 1 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc0008462a0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-jblfjr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-jblfjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000846220>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-jblfjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015d4600>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/d6c3e6e1-a3e3-4ef3-80a7-7d6e66e285d7",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T011957Z:ced5b521-bd7b-4f51-87af-95c4f398bece",
],
"Content-Length": ["342"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"a82fb0c7-45ed-4b00-881a-cdced9a42af5",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["1147"],
"X-Ms-Correlation-Request-Id": [
"ced5b521-bd7b-4f51-87af-95c4f398bece",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc0008462a0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-jblfjr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-jblfjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000846220>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-jblfjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-jblfjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015d4600>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/d6c3e6e1-a3e3-4ef3-80a7-7d6e66e285d7",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260311T011957Z:ced5b521-bd7b-4f51-87af-95c4f398bece",
],
"Content-Length": ["342"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"a82fb0c7-45ed-4b00-881a-cdced9a42af5",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["1147"],
"X-Ms-Correlation-Request-Id": [
"ced5b521-bd7b-4f51-87af-95c4f398bece",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapError | 0xc001686ec0>:
failed creating external auth "ea-list" in resourcegroup="ea-list-kthdbg" for cluster="ea-listrzg728": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list"
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating external auth \"ea-list\" in resourcegroup=\"ea-list-kthdbg\" for cluster=\"ea-listrzg728\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00078ade0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["330"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Correlation-Request-Id": [
"76f305c5-fa69-4ac9-9551-ae1c49be1677",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["192"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/927d5101-f4e6-4dbb-b7b6-eedffc1e63fb",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260310T021748Z:76f305c5-fa69-4ac9-9551-ae1c49be1677",
],
"X-Msedge-Ref": [
"Ref A: DE3DCB908678429D885260478E07FD22 Ref B: CHI261140506052 Ref C: 2026-03-10T02:17:47Z",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Tue, 10 Mar 2026 02:17:48 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"87a9e39a-4013-4c2d-9c4c-6c3c6dcebe75",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001686de0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 99, 114, 101, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 112, 97, 114, 101, 110, 116, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapError | 0xc001686ec0>:
failed creating external auth "ea-list" in resourcegroup="ea-list-kthdbg" for cluster="ea-listrzg728": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list"
}
}
--------------------------------------------------------------------------------
{
msg: "failed creating external auth \"ea-list\" in resourcegroup=\"ea-list-kthdbg\" for cluster=\"ea-listrzg728\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-kthdbg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listrzg728/externalAuths/ea-list\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00078ade0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["330"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Correlation-Request-Id": [
"76f305c5-fa69-4ac9-9551-ae1c49be1677",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["192"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/927d5101-f4e6-4dbb-b7b6-eedffc1e63fb",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260310T021748Z:76f305c5-fa69-4ac9-9551-ae1c49be1677",
],
"X-Msedge-Ref": [
"Ref A: DE3DCB908678429D885260478E07FD22 Ref B: CHI261140506052 Ref C: 2026-03-10T02:17:47Z",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Tue, 10 Mar 2026 02:17:48 GMT",
],
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Request-Id": [
"87a9e39a-4013-4c2d-9c4c-6c3c6dcebe75",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001686de0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 99, 114, 101, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 112, 97, 114, 101, 110, 116, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc000796180>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-g9dmqs": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-g9dmqs\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000796160>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-g9dmqs\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f002d0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Length": ["342"],
"X-Ms-Request-Id": [
"3390720e-9df1-4ec3-bca3-5b8c08d9aad9",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T023420Z:0ae2cd1e-878a-414b-83bd-de591313a919",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: F525233478294E04B588F5D72E44E37B Ref B: CHI261140506023 Ref C: 2026-03-09T02:34:20Z",
],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Envoy-Upstream-Service-Time": ["126"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"0ae2cd1e-878a-414b-83bd-de591313a919",
],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/ac773c95-5ddf-4064...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error:
<*fmt.wrapError | 0xc000796180>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-g9dmqs": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-g9dmqs\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000796160>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-g9dmqs\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-g9dmqs/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f002d0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Length": ["342"],
"X-Ms-Request-Id": [
"3390720e-9df1-4ec3-bca3-5b8c08d9aad9",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260309T023420Z:0ae2cd1e-878a-414b-83bd-de591313a919",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: F525233478294E04B588F5D72E44E37B Ref B: CHI261140506023 Ref C: 2026-03-09T02:34:20Z",
],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Envoy-Upstream-Service-Time": ["126"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"0ae2cd1e-878a-414b-83bd-de591313a919",
],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/ac773c95-5ddf-4064...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: ResourceGroupDeletionFailedfull failure pattern: ERROR CODE: ResourceGroupDeletionFailed Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 3 | 4.69%3 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 2 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc001716168>:
failed to cleanup resource group: failed waiting for resourcegroup="external-auth-cluster-b67ng8" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1FWFRFUk5BTDoyREFVVEg6MkRDTFVTVEVSOjJEQjY3Tkc4LUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'external-auth-cluster-b67ng8' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc000f5e3a0>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"external-auth-cluster-b67ng8\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1FWFRFUk5BTDoyREFVVEg6MkRDTFVTVEVSOjJEQjY3Tkc4LUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'external-auth-cluster-b67ng8' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f5e380>{
msg: "failed waiting for resourcegroup=\"external-auth-cluster-b67ng8\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1FWFRFUk5BTDoyREFVVEg6MkRDTFVTVEVSOjJEQjY3Tkc4LUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'external-auth-cluster-b67ng8' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001332a50>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Correlation-Request-Id": [
"8a7a4e2c-0c5c-420e-a471-80fa19b53da3",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 04:04:21 GMT",
],
"Content-Length": ["247"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260312T040421Z:8a7a4e2c-0c5c-420e-a471-80fa19b53da3",
],
"X-Ms-Request-Id": [
"8a7a4e2c-0c5c-420e-a471-80fa19b53da3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: D8B73840D3704...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc001716168>:
failed to cleanup resource group: failed waiting for resourcegroup="external-auth-cluster-b67ng8" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1FWFRFUk5BTDoyREFVVEg6MkRDTFVTVEVSOjJEQjY3Tkc4LUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'external-auth-cluster-b67ng8' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc000f5e3a0>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"external-auth-cluster-b67ng8\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1FWFRFUk5BTDoyREFVVEg6MkRDTFVTVEVSOjJEQjY3Tkc4LUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'external-auth-cluster-b67ng8' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f5e380>{
msg: "failed waiting for resourcegroup=\"external-auth-cluster-b67ng8\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1FWFRFUk5BTDoyREFVVEg6MkRDTFVTVEVSOjJEQjY3Tkc4LUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'external-auth-cluster-b67ng8' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001332a50>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Correlation-Request-Id": [
"8a7a4e2c-0c5c-420e-a471-80fa19b53da3",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Thu, 12 Mar 2026 04:04:21 GMT",
],
"Content-Length": ["247"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260312T040421Z:8a7a4e2c-0c5c-420e-a471-80fa19b53da3",
],
"X-Ms-Request-Id": [
"8a7a4e2c-0c5c-420e-a471-80fa19b53da3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: D8B73840D3704...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000d743d8>:
failed to cleanup resource group: failed waiting for resourcegroup="cluster-listing-76k4gt" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1DTFVTVEVSOjJETElTVElORzoyRDc2SzRHVC1FQVNUVVMyIiwiam9iTG9jYXRpb24iOiJlYXN0dXMyIn0
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'cluster-listing-76k4gt' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc0004aaa40>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"cluster-listing-76k4gt\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1DTFVTVEVSOjJETElTVElORzoyRDc2SzRHVC1FQVNUVVMyIiwiam9iTG9jYXRpb24iOiJlYXN0dXMyIn0\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'cluster-listing-76k4gt' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0004aaa20>{
msg: "failed waiting for resourcegroup=\"cluster-listing-76k4gt\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1DTFVTVEVSOjJETElTVElORzoyRDc2SzRHVC1FQVNUVVMyIiwiam9iTG9jYXRpb24iOiJlYXN0dXMyIn0\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'cluster-listing-76k4gt' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001422fc0>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"c656b4eb-b02d-4689-9e61-ae252c2c4c34",
],
"X-Ms-Correlation-Request-Id": [
"c656b4eb-b02d-4689-9e61-ae252c2c4c34",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260312T011924Z:c656b4eb-b02d-4689-9e61-ae252c2c4c34",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Msedge-Ref": [
"Ref A: AAC5210B403E49FB999F61B4009EE151 Ref B: CHI261140501034 Ref C: 2026-03-12T01:19:24Z",
],
"Content-Length": ["241"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Rateli...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc000d743d8>:
failed to cleanup resource group: failed waiting for resourcegroup="cluster-listing-76k4gt" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1DTFVTVEVSOjJETElTVElORzoyRDc2SzRHVC1FQVNUVVMyIiwiam9iTG9jYXRpb24iOiJlYXN0dXMyIn0
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'cluster-listing-76k4gt' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc0004aaa40>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"cluster-listing-76k4gt\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1DTFVTVEVSOjJETElTVElORzoyRDc2SzRHVC1FQVNUVVMyIiwiam9iTG9jYXRpb24iOiJlYXN0dXMyIn0\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'cluster-listing-76k4gt' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0004aaa20>{
msg: "failed waiting for resourcegroup=\"cluster-listing-76k4gt\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1DTFVTVEVSOjJETElTVElORzoyRDc2SzRHVC1FQVNUVVMyIiwiam9iTG9jYXRpb24iOiJlYXN0dXMyIn0\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'cluster-listing-76k4gt' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001422fc0>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"c656b4eb-b02d-4689-9e61-ae252c2c4c34",
],
"X-Ms-Correlation-Request-Id": [
"c656b4eb-b02d-4689-9e61-ae252c2c4c34",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260312T011924Z:c656b4eb-b02d-4689-9e61-ae252c2c4c34",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Msedge-Ref": [
"Ref A: AAC5210B403E49FB999F61B4009EE151 Ref B: CHI261140501034 Ref C: 2026-03-12T01:19:24Z",
],
"Content-Length": ["241"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Rateli...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0017da1e0>:
failed to cleanup resource group: failed waiting for resourcegroup="np-autoscaling-6s9m8d" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJENlM5TThELUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'np-autoscaling-6s9m8d' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc0008f0640>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"np-autoscaling-6s9m8d\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJENlM5TThELUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-6s9m8d' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008f0620>{
msg: "failed waiting for resourcegroup=\"np-autoscaling-6s9m8d\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJENlM5TThELUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-6s9m8d' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00179b020>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"cea47c2d-2981-4421-823b-471c674aec92",
],
"X-Msedge-Ref": [
"Ref A: B01DBF5715B64D88B52211B87B87B981 Ref B: CHI261140503054 Ref C: 2026-03-12T00:03:45Z",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260312T000346Z:cea47c2d-2981-4421-823b-471c674aec92",
],
"Date": [
"Thu, 12 Mar 2026 00:03:45 GMT",
],
"Content-Length": ["240"],
"Content-Type": [
"application/json; charset=utf-8",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
<*errors.joinError | 0xc0017da1e0>:
failed to cleanup resource group: failed waiting for resourcegroup="np-autoscaling-6s9m8d" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJENlM5TThELUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: ResourceGroupDeletionFailed
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceGroupDeletionFailed",
"message": "The deletion of resource group 'np-autoscaling-6s9m8d' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details."
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc0008f0640>{
msg: "failed to cleanup resource group: failed waiting for resourcegroup=\"np-autoscaling-6s9m8d\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJENlM5TThELUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-6s9m8d' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008f0620>{
msg: "failed waiting for resourcegroup=\"np-autoscaling-6s9m8d\" to finish deleting: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/operationresults/eyJqb2JJZCI6IlJFU09VUkNFR1JPVVBERUxFVElPTkpPQi1OUDoyREFVVE9TQ0FMSU5HOjJENlM5TThELUVBU1RVUzIiLCJqb2JMb2NhdGlvbiI6ImVhc3R1czIifQ\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupDeletionFailed\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceGroupDeletionFailed\",\n \"message\": \"The deletion of resource group 'np-autoscaling-6s9m8d' did not finish within allowed time. Resource group provisioning state rolled back. Please check audit logs for more details.\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00179b020>{
ErrorCode: "ResourceGroupDeletionFailed",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"cea47c2d-2981-4421-823b-471c674aec92",
],
"X-Msedge-Ref": [
"Ref A: B01DBF5715B64D88B52211B87B87B981 Ref B: CHI261140503054 Ref C: 2026-03-12T00:03:45Z",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260312T000346Z:cea47c2d-2981-4421-823b-471c674aec92",
],
"Date": [
"Thu, 12 Mar 2026 00:03:45 GMT",
],
"Content-Length": ["240"],
"Content-Type": [
"application/json; charset=utf-8",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (3)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Test Panickedfull failure pattern: Test Panicked Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 2 | 3.12%2 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 25 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e90140?, {0x7ff6a549ca60?, 0xc000b0d170?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000dc4a20, {0x7ff6a549ca60, 0xc000b0d170}, {0x781cf8c, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func5.1.1({0x7ff6a549ca60, 0xc000b0d170})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:68 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000b0d170?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 85
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e90140?, {0x7ff6a549ca60?, 0xc000b0d170?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000dc4a20, {0x7ff6a549ca60, 0xc000b0d170}, {0x781cf8c, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func5.1.1({0x7ff6a549ca60, 0xc000b0d170})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:68 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000b0d170?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 85
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000aca550?, {0x7f5094d33060?, 0xc000e80c90?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0008ab0e0, {0x7f5094d33060, 0xc000e80c90}, {0x784e4b5, 0x1f}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func3.1({0x7f5094d33060, 0xc000e80c90})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:66 +0x13f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e80c90?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 62
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000aca550?, {0x7f5094d33060?, 0xc000e80c90?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0008ab0e0, {0x7f5094d33060, 0xc000e80c90}, {0x784e4b5, 0x1f}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func3.1({0x7f5094d33060, 0xc000e80c90})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:66 +0x13f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e80c90?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 62
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).Get20240610ClientFactoryOrDie(0x78497cf?, {0x7f81f89bf020?, 0xc000ea21e0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:611 +0x37
github.com/Azure/ARO-HCP/test/e2e.init.func1.1({0x7f81f89bf020, 0xc000ea21e0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:38 +0x6f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ea21e0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 88
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).Get20240610ClientFactoryOrDie(0x78497cf?, {0x7f81f89bf020?, 0xc000ea21e0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:611 +0x37
github.com/Azure/ARO-HCP/test/e2e.init.func1.1({0x7f81f89bf020, 0xc000ea21e0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:38 +0x6f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ea21e0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 88
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test PanickedContributing tests (17)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster credsfull failure pattern: timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | e2e | 2 | 3.12%2 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | Show trend detailsMar 2: 1 · Mar 3: 6 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
<*fmt.wrapErrors | 0xc0007de9f0>:
failed waiting for hcpCluster="admin-cred-lifecycle-kwvkmn" in resourcegroup="admin-credential-lifecycle-test-h4bz6t" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-kwvkmn\" in resourcegroup=\"admin-credential-lifecycle-test-h4bz6t\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a8b2e0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
<*fmt.wrapErrors | 0xc0007de9f0>:
failed waiting for hcpCluster="admin-cred-lifecycle-kwvkmn" in resourcegroup="admin-credential-lifecycle-test-h4bz6t" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-kwvkmn\" in resourcegroup=\"admin-credential-lifecycle-test-h4bz6t\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a8b2e0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
<*fmt.wrapErrors | 0xc000d74b10>:
failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-jqxbnn" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-jqxbnn\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a12210>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
<*fmt.wrapErrors | 0xc000d74b10>:
failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-jqxbnn" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-jqxbnn\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a12210>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapErrors | 0xc001488b40>:
failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-svgd9j" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-svgd9j\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0002ff5c0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapErrors | 0xc001488b40>:
failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-svgd9j" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-svgd9j\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0002ff5c0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (6)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 3.12%2 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapError | 0xc00049ee40>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00147a210>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["3041"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/5f33cbb9-f37a-429b-bce1-8edaf9908424",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260305T021539Z:547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: AD38B254178B410585C028F8AB33DE1C Ref B: CH1AA2020610031 Ref C: 2026-03-05T02:15:35Z",
],
"Date": [
"Thu, 05 Mar 2026 02:15:38 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"b2ef27e1-1259-4b08-a852-40ef41f5feca",
],
"X-Ms-Correlation-Request-Id": [
"547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["319"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
},
Body: <*exported.nopClosingBytesReader | 0xc00049ece0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapError | 0xc00049ee40>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00147a210>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["3041"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/5f33cbb9-f37a-429b-bce1-8edaf9908424",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260305T021539Z:547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: AD38B254178B410585C028F8AB33DE1C Ref B: CH1AA2020610031 Ref C: 2026-03-05T02:15:35Z",
],
"Date": [
"Thu, 05 Mar 2026 02:15:38 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"b2ef27e1-1259-4b08-a852-40ef41f5feca",
],
"X-Ms-Correlation-Request-Id": [
"547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["319"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
},
Body: <*exported.nopClosingBytesReader | 0xc00049ece0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc000d461a0>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014c8630>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Envoy-Upstream-Service-Time": ["24"],
"X-Ms-Correlation-Request-Id": [
"04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260304T114425Z:04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["316"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/75e212f8-cdc9-4ef9-961a-651c91f9ecd9",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"51931baa-6371-4efa-a708-4f0f312f1ca0",
],
"Date": [
"Wed, 04 Mar 2026 11:44:25 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 8417EFDD14874F8BB0E5237BA546D57F Ref B: CHI261140512040 Ref C: 2026-03-04T11:44:25Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d46000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc000d461a0>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014c8630>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Envoy-Upstream-Service-Time": ["24"],
"X-Ms-Correlation-Request-Id": [
"04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260304T114425Z:04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["316"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/75e212f8-cdc9-4ef9-961a-651c91f9ecd9",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"51931baa-6371-4efa-a708-4f0f312f1ca0",
],
"Date": [
"Wed, 04 Mar 2026 11:44:25 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 8417EFDD14874F8BB0E5237BA546D57F Ref B: CHI261140512040 Ref C: 2026-03-04T11:44:25Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d46000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail code DenyAssignmentLimitExceeded; detail message Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at S...full failure pattern: ERROR CODE: InternalServerError; detail code DenyAssignmentLimitExceeded; detail message Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/<subscription> with search direction ScopeAndBelow. The limit is 2000.; provider Microsoft.Authorization Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 2 | 3.12%2 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 2 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc000579080>:
failed to create HCP cluster list-test-cluster-bq97s7: failed waiting for cluster="list-test-cluster-bq97s7" in resourcegroup="cluster-listing-8872x6" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d",
"name": "46ace568-dc35-4c4f-a79f-7a406de3e15d",
"status": "Failed",
"startTime": "2026-03-11T21:08:47.154344146Z",
"endTime": "2026-03-11T21:11:43.134589726Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/e663d1f0-257c-5415-abc3-7d8e5bb59e36\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/fcc1607d-beb4-5621-906c-726f36422d8f\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/4248f691-af43-5fc6-a0fc-cbd9ca13f47c\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/16f02e63-3112-56ed-ab9e-b36ab322b94f\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/288c454f-fa20-5a8b-9030-d232fc0074e7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/759088cd-864a-5f85-a334-2d9f3586f3fe\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/697e01a8-0c71-5420-b5d7-b53e6ad28d24\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/abb26984-e70f-55ad-a446-57d39d785f3a\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/077c8d44-0b2f-5e41-92d6-dc648b293341\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/895f6214-21ec-57d1-85d4-e824b8d4a5cd\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/97a2ea1b-62a8-572b-80f0-cd3287f6deae\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/bcbac9ff-fd4b-57bd-81c1-11bd09c72bc0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/3af59b2e-b060-5c22-b9cd-9098bcb77878\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/30cb8efd-9d43-5c50-9daa-9375ce14fe98\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-bq97s7: failed waiting for cluster=\"list-test-cluster-bq97s7\" in resourcegroup=\"cluster-listing-8872x6\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d\",\n \"name\": \"46ace568-dc35-4c4f-a79f-7a406de3e15d\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T21:08:47.154344146Z\",\n \"endTime\": \"2026-03-11T21:11:43.134589726Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/e663d1f0-257c-5415-abc3-7d8e5bb59e36\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/fcc1607d-beb4-5621-906c-726f36422d8f\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/4248f691-af43-5fc6-a0fc-cbd9ca13f47c\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/16f02e63-3112-56ed-ab9e-b36ab322b94f\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Ba...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc000579080>:
failed to create HCP cluster list-test-cluster-bq97s7: failed waiting for cluster="list-test-cluster-bq97s7" in resourcegroup="cluster-listing-8872x6" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d",
"name": "46ace568-dc35-4c4f-a79f-7a406de3e15d",
"status": "Failed",
"startTime": "2026-03-11T21:08:47.154344146Z",
"endTime": "2026-03-11T21:11:43.134589726Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/e663d1f0-257c-5415-abc3-7d8e5bb59e36\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/fcc1607d-beb4-5621-906c-726f36422d8f\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/4248f691-af43-5fc6-a0fc-cbd9ca13f47c\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/16f02e63-3112-56ed-ab9e-b36ab322b94f\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/288c454f-fa20-5a8b-9030-d232fc0074e7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/759088cd-864a-5f85-a334-2d9f3586f3fe\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/697e01a8-0c71-5420-b5d7-b53e6ad28d24\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/abb26984-e70f-55ad-a446-57d39d785f3a\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/077c8d44-0b2f-5e41-92d6-dc648b293341\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/895f6214-21ec-57d1-85d4-e824b8d4a5cd\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/97a2ea1b-62a8-572b-80f0-cd3287f6deae\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/bcbac9ff-fd4b-57bd-81c1-11bd09c72bc0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/3af59b2e-b060-5c22-b9cd-9098bcb77878\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/30cb8efd-9d43-5c50-9daa-9375ce14fe98\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-bq97s7: failed waiting for cluster=\"list-test-cluster-bq97s7\" in resourcegroup=\"cluster-listing-8872x6\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/australiaeast/hcpOperationStatuses/46ace568-dc35-4c4f-a79f-7a406de3e15d\",\n \"name\": \"46ace568-dc35-4c4f-a79f-7a406de3e15d\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T21:08:47.154344146Z\",\n \"endTime\": \"2026-03-11T21:11:43.134589726Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/e663d1f0-257c-5415-abc3-7d8e5bb59e36\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/fcc1607d-beb4-5621-906c-726f36422d8f\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/4248f691-af43-5fc6-a0fc-cbd9ca13f47c\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-8872x6-managed/providers/Microsoft.Authorization/denyAssignments/16f02e63-3112-56ed-ab9e-b36ab322b94f\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Ba...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc00097c280>:
failed to create HCP cluster list-test-cluster-jpcgwk: failed waiting for cluster="list-test-cluster-jpcgwk" in resourcegroup="cluster-listing-2jgp6g" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920",
"name": "625b1b18-4c75-473a-934a-a164ea9e7920",
"status": "Failed",
"startTime": "2026-03-11T21:08:59.912972248Z",
"endTime": "2026-03-11T21:11:11.150064729Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/c830eb67-f4cc-5c33-a275-01641a3773ec\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/439dd205-e252-5fd3-8924-58746f329066\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/faa2951f-b181-51b3-a546-c3af6657963e\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-jpcgwk: failed waiting for cluster=\"list-test-cluster-jpcgwk\" in resourcegroup=\"cluster-listing-2jgp6g\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920\",\n \"name\": \"625b1b18-4c75-473a-934a-a164ea9e7920\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T21:08:59.912972248Z\",\n \"endTime\": \"2026-03-11T21:11:11.150064729Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/c830eb67-f4cc-5c33-a275-01641a3773ec\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/439dd205-e252-5fd3-8924-58746f329066\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/faa2951f-b181-51b3-a546-c3af6657963e\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00097c260>{
msg: "failed waiting for cluster=\"list-test-cluster-jpcgwk\" in resourcegroup=\"cluster-listing-2jgp6g\" to finish creating: GET https://management.azure.com/subscriptio...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc00097c280>:
failed to create HCP cluster list-test-cluster-jpcgwk: failed waiting for cluster="list-test-cluster-jpcgwk" in resourcegroup="cluster-listing-2jgp6g" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920",
"name": "625b1b18-4c75-473a-934a-a164ea9e7920",
"status": "Failed",
"startTime": "2026-03-11T21:08:59.912972248Z",
"endTime": "2026-03-11T21:11:11.150064729Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/c830eb67-f4cc-5c33-a275-01641a3773ec\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/439dd205-e252-5fd3-8924-58746f329066\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/faa2951f-b181-51b3-a546-c3af6657963e\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: DenyAssignmentLimitExceeded\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"DenyAssignmentLimitExceeded\",\n \"message\": \"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-jpcgwk: failed waiting for cluster=\"list-test-cluster-jpcgwk\" in resourcegroup=\"cluster-listing-2jgp6g\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/625b1b18-4c75-473a-934a-a164ea9e7920\",\n \"name\": \"625b1b18-4c75-473a-934a-a164ea9e7920\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-11T21:08:59.912972248Z\",\n \"endTime\": \"2026-03-11T21:11:11.150064729Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/c830eb67-f4cc-5c33-a275-01641a3773ec\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/439dd205-e252-5fd3-8924-58746f329066\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-2jgp6g-managed/providers/Microsoft.Authorization/denyAssignments/faa2951f-b181-51b3-a546-c3af6657963e\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: DenyAssignmentLimitExceeded\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"DenyAssignmentLimitExceeded\\\",\\n \\\"message\\\": \\\"Cannot add a new DenyAssignment to the store. There are already 2000 deny assignments at Scope=/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX with search direction ScopeAndBelow. The limit is 2000.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00097c260>{
msg: "failed waiting for cluster=\"list-test-cluster-jpcgwk\" in resourcegroup=\"cluster-listing-2jgp6g\" to finish creating: GET https://management.azure.com/subscriptio...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: c...full failure pattern: failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 2 | 3.12%2 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 2 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc0016f80f0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-qks87c" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc00073ddc0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-qks87c\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00073dda0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-qks87c\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00073d8e0>{
msg: "failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-qks87c\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb0680c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc0016f80f0>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-qks87c" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc00073ddc0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-qks87c\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00073dda0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-qks87c\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00073d8e0>{
msg: "failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-qks87c\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb0680c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000fb62e8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-qb9hch" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc00095f2a0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-qb9hch\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00095f280>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-qb9hch\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00095f260>{
msg: "failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-qb9hch\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb0680c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
<*errors.joinError | 0xc000fb62e8>:
failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-qb9hch" to finish deleting: context canceled
{
errs: [
<*fmt.wrapError | 0xc00095f2a0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-qb9hch\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00095f280>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-qb9hch\" to finish deleting: context canceled",
err: <*fmt.wrapError | 0xc00095f260>{
msg: "failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-qb9hch\" to finish deleting: context canceled",
err: <*errors.errorString | 0xb0680c0>{
s: "context canceled",
},
},
},
},
],
}
occurred
fail [:0]: A node timeout occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceededfull failure pattern: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | e2e | 2 | 3.12%2 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | Show trend detailsMar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc001195460>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-zqs4nb" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-zqs4nb\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc001195460>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-zqs4nb" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-zqs4nb\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc0009152c0>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-w4wfkv" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-w4wfkv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc0009152c0>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-w4wfkv" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-w4wfkv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 5 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapError | 0xc0007439c0>:
failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-rggf4c" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"name": "b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"status": "Failed",
"startTime": "2026-03-04T11:42:32.91171511Z",
"endTime": "2026-03-04T11:45:01.618825129Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0007439a0>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000679c80>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114509Z:d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Msedge-Ref": [
"Ref A: C1EE60EB4B804177AABFC80DC74FA33E Ref B: CHI261140501054 Ref C: 2026-03-04T11:45:08Z",
],
"X-Ms-Correlation-Request-Id": [
"d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"Content-Length": ["498"],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/78cb4115-38f4-400a-a373-de90cb3f6447",
],
"X-Ms-Ratelimit-Remaining...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapError | 0xc0007439c0>:
failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-rggf4c" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"name": "b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"status": "Failed",
"startTime": "2026-03-04T11:42:32.91171511Z",
"endTime": "2026-03-04T11:45:01.618825129Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0007439a0>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000679c80>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114509Z:d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Msedge-Ref": [
"Ref A: C1EE60EB4B804177AABFC80DC74FA33E Ref B: CHI261140501054 Ref C: 2026-03-04T11:45:08Z",
],
"X-Ms-Correlation-Request-Id": [
"d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"Content-Length": ["498"],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/78cb4115-38f4-400a-a373-de90cb3f6447",
],
"X-Ms-Ratelimit-Remaining...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0008963e0>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-4ljw7f" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd",
"name": "8e2e6926-ad32-404f-9710-045e248d82cd",
"status": "Failed",
"startTime": "2026-03-04T11:42:34.945511327Z",
"endTime": "2026-03-04T11:49:48.715948579Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008963c0>{
msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00128c5a0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["499"],
"X-Ms-Correlation-Request-Id": [
"8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114951Z:8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Wed, 04 Mar 2026 11:49:50 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/43fae7b6-ce0d-421e-b423-059eca2efbf5",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0008963e0>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-4ljw7f" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd",
"name": "8e2e6926-ad32-404f-9710-045e248d82cd",
"status": "Failed",
"startTime": "2026-03-04T11:42:34.945511327Z",
"endTime": "2026-03-04T11:49:48.715948579Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008963c0>{
msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00128c5a0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["499"],
"X-Ms-Correlation-Request-Id": [
"8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114951Z:8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Wed, 04 Mar 2026 11:49:50 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/43fae7b6-ce0d-421e-b423-059eca2efbf5",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc000f06a60>:
failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster="list-test-cluster-p6lb7l" in resourcegroup="cluster-listing-dlgx6v" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87",
"name": "4019f702-1223-4f14-b6db-2e256f1f2a87",
"status": "Failed",
"startTime": "2026-03-04T11:40:19.135177985Z",
"endTime": "2026-03-04T11:45:00.015034663Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f06a40>{
msg: "failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00122cd20>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["19"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/8ffb5ba3-48ab-446c-a59c-3f9d09ee97a7",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114501Z:4d14fc79-c15b-43f1-b5fc-ec2ab314d07f",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Request-Id": [
"a63da353-17cb-482c-9907-e48691e47dad",
],
"Pragma": ["no-cache"],
"Content-Length": ["499"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Msedge-Ref": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc000f06a60>:
failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster="list-test-cluster-p6lb7l" in resourcegroup="cluster-listing-dlgx6v" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87",
"name": "4019f702-1223-4f14-b6db-2e256f1f2a87",
"status": "Failed",
"startTime": "2026-03-04T11:40:19.135177985Z",
"endTime": "2026-03-04T11:45:00.015034663Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f06a40>{
msg: "failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00122cd20>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["19"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/8ffb5ba3-48ab-446c-a59c-3f9d09ee97a7",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114501Z:4d14fc79-c15b-43f1-b5fc-ec2ab314d07f",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Request-Id": [
"a63da353-17cb-482c-9907-e48691e47dad",
],
"Pragma": ["no-cache"],
"Content-Length": ["499"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Msedge-Ref": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (5)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail code PublicIPCountLimitReached; detail message Cannot create more than 300 public IP addresses for this subscription in this region.; provi...full failure pattern: ERROR CODE: InternalServerError; detail code PublicIPCountLimitReached; detail message Cannot create more than 300 public IP addresses for this subscription in this region.; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 4 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
<*fmt.wrapError | 0xc001050900>:
failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-42hshj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"name": "6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"status": "Failed",
"startTime": "2026-03-04T11:27:28.76644337Z",
"endTime": "2026-03-04T11:33:55.189840009Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-42hshj\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"name\": \"6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:27:28.76644337Z\",\n \"endTime\": \"2026-03-04T11:33:55.189840009Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses f...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
<*fmt.wrapError | 0xc001050900>:
failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-42hshj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"name": "6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"status": "Failed",
"startTime": "2026-03-04T11:27:28.76644337Z",
"endTime": "2026-03-04T11:33:55.189840009Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-42hshj\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"name\": \"6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:27:28.76644337Z\",\n \"endTime\": \"2026-03-04T11:33:55.189840009Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses f...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c090a0>:
failed to create HCP cluster node-limit-cluster: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-v554wg" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"name": "b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"status": "Failed",
"startTime": "2026-03-04T11:29:07.030229354Z",
"endTime": "2026-03-04T11:33:56.440551062Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-v554wg\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"name\": \"b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:29:07.030229354Z\",\n \"endTime\": \"2026-03-04T11:33:56.440551062Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c090a0>:
failed to create HCP cluster node-limit-cluster: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-v554wg" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"name": "b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"status": "Failed",
"startTime": "2026-03-04T11:29:07.030229354Z",
"endTime": "2026-03-04T11:33:56.440551062Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-v554wg\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"name\": \"b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:29:07.030229354Z\",\n \"endTime\": \"2026-03-04T11:33:56.440551062Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129]: Unexpected error:
<*exported.ResponseError | 0xc001696270>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592",
"name": "0b35155f-1c87-4a27-b264-b5ffaf2df592",
"status": "Failed",
"startTime": "2026-03-04T11:27:10.141510238Z",
"endTime": "2026-03-04T11:33:01.507880583Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Content-Length": ["7006"],
"X-Ms-Request-Id": [
"8f5597b5-16fa-4df6-bd73-65ab0a1bb005",
],
"X-Envoy-Upstream-Service-Time": ["10"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Correlation-Request-Id": [
"bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/eec24277-b57a-425a-a5e4-071fef365907",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T113304Z:bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7BD958C08EC847A19E41507ED24FBCAF Ref B: CHI261140510034 Ref C: 2026-03-04T11:33:03Z",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 04 Mar 2026 11:33:03 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000e12000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 117, 107, 115, 111, 117, 116, 104, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 50, 55, 58, 49, 48, 46, 49, 52, 49, 53, 49, 48, 50, 51, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 51, 51, 58, 48, 49, 46, 53, 48, 55, 56, 56, 48, 53, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 80, 85, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129]: Unexpected error:
<*exported.ResponseError | 0xc001696270>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592",
"name": "0b35155f-1c87-4a27-b264-b5ffaf2df592",
"status": "Failed",
"startTime": "2026-03-04T11:27:10.141510238Z",
"endTime": "2026-03-04T11:33:01.507880583Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Content-Length": ["7006"],
"X-Ms-Request-Id": [
"8f5597b5-16fa-4df6-bd73-65ab0a1bb005",
],
"X-Envoy-Upstream-Service-Time": ["10"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Correlation-Request-Id": [
"bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/eec24277-b57a-425a-a5e4-071fef365907",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T113304Z:bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7BD958C08EC847A19E41507ED24FBCAF Ref B: CHI261140510034 Ref C: 2026-03-04T11:33:03Z",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 04 Mar 2026 11:33:03 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000e12000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 117, 107, 115, 111, 117, 116, 104, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 50, 55, 58, 49, 48, 46, 49, 52, 49, 53, 49, 48, 50, 51, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 51, 51, 58, 48, 49, 46, 53, 48, 55, 56, 56, 48, 53, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 80, 85, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (4)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle: Cluster provisioning failedfull failure pattern: Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle: Cluster provisioning failed Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:153]: Cluster provisioning failed fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:153]: Cluster provisioning failed Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Should receive valid HTTP status code from authorized IPfull failure pattern: Should receive valid HTTP status code from authorized IP Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.001s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.001s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Value for field 'Issuer.CommonName' failed to satisfy matcher.full failure pattern: Value for field 'Issuer.CommonName' failed to satisfy matcher. Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 1 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:149]: Timed out after 240.001s.
expect certificate to be issued by Microsoft
Value for field 'Issuer.CommonName' failed to satisfy matcher.
Expected
<string>: root-ca
to match regular expression
<string>: Microsoft\sAzure\sRSA\sTLS\sIssuing\sCA\s[0-9]+
fail [/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:149]: Timed out after 240.001s.
expect certificate to be issued by Microsoft
Value for field 'Issuer.CommonName' failed to satisfy matcher.
Expected
<string>: root-ca
to match regular expression
<string>: Microsoft\sAzure\sRSA\sTLS\sIssuing\sCA\s[0-9]+Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4full failure pattern: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4 Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 1 · Mar 14: 0 · Mar 15: 0 | INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.006s.
Expected success, but got an error:
<*errors.joinError | 0xc000f195d8>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc000cbc700>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0008f4540>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.006s.
Expected success, but got an error:
<*errors.joinError | 0xc000f195d8>:
VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15"
{
errs: [
<*fmt.wrapError | 0xc000cbc700>{
msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
err: <*errors.errorString | 0xc0008f4540>{
s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"",
},
},
],
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create route: the server is currently unable to handle the requestfull failure pattern: failed to create route: the server is currently unable to handle the request Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 0 · Mar 12: 0 · Mar 13: 1 · Mar 14: 0 · Mar 15: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc0009bfcc0>:
failed to create route: the server is currently unable to handle the request
{
msg: "failed to create route: the server is currently unable to handle the request",
err: <*errors.StatusError | 0xc000f1fe00>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "the server is currently unable to handle the request",
Reason: "ServiceUnavailable",
Details: {
Name: "",
Group: "",
Kind: "",
UID: "",
Causes: [
{
Type: "UnexpectedServerResponse",
Message: "error trying to reach service: tls: first record does not look like a TLS handshake",
Field: "",
},
],
RetryAfterSeconds: 0,
},
Code: 503,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc0009bfcc0>:
failed to create route: the server is currently unable to handle the request
{
msg: "failed to create route: the server is currently unable to handle the request",
err: <*errors.StatusError | 0xc000f1fe00>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "the server is currently unable to handle the request",
Reason: "ServiceUnavailable",
Details: {
Name: "",
Group: "",
Kind: "",
UID: "",
Causes: [
{
Type: "UnexpectedServerResponse",
Message: "error trying to reach service: tls: first record does not look like a TLS handshake",
Field: "",
},
],
RetryAfterSeconds: 0,
},
Code: 503,
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
or adjust the parameters in Gomega's 'format' package.full failure pattern: or adjust the parameters in Gomega's 'format' package. Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc0013df1a0>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: NotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NotFound",
"message": "Cluster '2ov6s0cpl7gkpuue1b516qhk8cdsmabo' not found"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "NotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Length": ["126"],
"X-Envoy-Upstream-Service-Time": ["584"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260311T013040Z:c842b23a-1dd5-473c-a571-3d4df49b88a4",
],
"X-Msedge-Ref": [
"Ref A: 0090BB3CE36E41728AA688E9FBBE247F Ref B: CHI261140503023 Ref C: 2026-03-11T01:30:39Z",
],
"X-Ms-Error-Code": ["NotFound"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"c842b23a-1dd5-473c-a571-3d4df49b88a4",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 11 Mar 2026 01:30:40 GMT",
],
"X-Ms-Request-Id": [
"7385551f-2b14-46ef-b16b-b7df9d55e6e4",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001484b80>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 108, 117, 115, 116, 101, 114, 32, 39, 50, 111, 118, 54, 115, 48, 99, 112, 108, 55, 103, 107, 112, 117, 117, 101, 49, 98, 53, 49, 54, 113, 104, 107, 56, 99, 100, 115, 109, 97, 98, 111, 39, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 126,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc0013df1a0>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: NotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NotFound",
"message": "Cluster '2ov6s0cpl7gkpuue1b516qhk8cdsmabo' not found"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "NotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Content-Length": ["126"],
"X-Envoy-Upstream-Service-Time": ["584"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260311T013040Z:c842b23a-1dd5-473c-a571-3d4df49b88a4",
],
"X-Msedge-Ref": [
"Ref A: 0090BB3CE36E41728AA688E9FBBE247F Ref B: CHI261140503023 Ref C: 2026-03-11T01:30:39Z",
],
"X-Ms-Error-Code": ["NotFound"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"c842b23a-1dd5-473c-a571-3d4df49b88a4",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 11 Mar 2026 01:30:40 GMT",
],
"X-Ms-Request-Id": [
"7385551f-2b14-46ef-b16b-b7df9d55e6e4",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001484b80>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 108, 117, 115, 116, 101, 114, 32, 39, 50, 111, 118, 54, 115, 48, 99, 112, 108, 55, 103, 107, 112, 117, 117, 101, 49, 98, 53, 49, 54, 113, 104, 107, 56, 99, 100, 115, 109, 97, 98, 111, 39, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 126,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nilContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
route host was never found: Get "<url>": dial tcp <ip>:<port>: i/o timeoutfull failure pattern: route host was never found: Get "<url>": dial tcp <ip>:<port>: i/o timeout Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 1.56%1 of 64 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1 · Mar 12: 0 · Mar 13: 0 · Mar 14: 0 · Mar 15: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc0008ac140>:
route host was never found: Get "https://agnhost-e2e-serving-app-qm5jk.apps.aro.a5a4c4g0z8w2g8w.e8s3.canadacentral.aroapp-hcp.io": dial tcp 20.116.240.254:443: i/o timeout
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-qm5jk.apps.aro.a5a4c4g0z8w2g8w.e8s3.canadacentral.aroapp-hcp.io\": dial tcp 20.116.240.254:443: i/o timeout",
err: <*url.Error | 0xc000f84300>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-qm5jk.apps.aro.a5a4c4g0z8w2g8w.e8s3.canadacentral.aroapp-hcp.io",
Err: <*net.OpError | 0xc000cb8320>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc000f842d0>{
IP: [20, 116, 240, 254],
Port: 443,
Zone: "",
},
Err: <*net.timeoutError | 0xb35be00>{},
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc0008ac140>:
route host was never found: Get "https://agnhost-e2e-serving-app-qm5jk.apps.aro.a5a4c4g0z8w2g8w.e8s3.canadacentral.aroapp-hcp.io": dial tcp 20.116.240.254:443: i/o timeout
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-qm5jk.apps.aro.a5a4c4g0z8w2g8w.e8s3.canadacentral.aroapp-hcp.io\": dial tcp 20.116.240.254:443: i/o timeout",
err: <*url.Error | 0xc000f84300>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-qm5jk.apps.aro.a5a4c4g0z8w2g8w.e8s3.canadacentral.aroapp-hcp.io",
Err: <*net.OpError | 0xc000cb8320>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc000f842d0>{
IP: [20, 116, 240, 254],
Port: 443,
Zone: "",
},
Err: <*net.timeoutError | 0xb35be00>{},
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||