Executive Status
EnvEnvironment partition: dev, int, stg, or prod. | GoalConfigured success target and run scope for this environment. INT/STG/PROD use all E2E job runs. DEV uses post-good runs plus Tide batches: runs on the final commit of a PR that later merged, or batch retests of PRs that passed their individual e2e-parallel checks. | RunsNumber of job runs in the selected goal definition for this environment. | SuccessSuccess rate on the selected goal definition: (runs - failed runs) / runs * 100. | Gap vs targetDifference in percentage points between current success and the configured target rate. | Change vs prevHow much the success rate changed compared with the immediately preceding equal-length window, using the same goal definition as this row. | Provision successProvisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step. DEV rows use post-good runs plus Tide batches. INT/STG/PROD show n/a because provisioning is not part of those environments. | Provision change vs prevChange in provision success, in percentage points, compared with the previous equal-length window. Uses the same provision-success definition as the Provision success column. DEV only; INT/STG/PROD show n/a. | E2E successAmong runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step. DEV rows use only runs after the final push to a PR that later merged. INT/STG/PROD use all E2E job runs. | E2E success vs prevChange in E2E success, in percentage points, compared with the previous equal-length window. Uses the same E2E-success definition as the E2E success column. |
|---|---|---|---|---|---|---|---|---|---|
| DEV | 95% - Post-good runs + Tide batches | 197 | 62.44% (off track) | -32.56pp | +4.62pp | 68.23% (131/192) | -7.30pp | 93.89% (123/131) | +15.72pp |
| INT | 95% - All E2E job runs | 31 | 45.16% (off track) | -49.84pp | -13.66pp | n/a | n/a | 45.16% (14/31) | -13.66pp |
| STG | 95% - All E2E job runs | 16 | 43.75% (off track) | -51.25pp | -56.25pp | n/a | n/a | 43.75% (7/16) | -56.25pp |
| PROD | 95% - All E2E job runs | 24 | 45.83% (off track) | -49.17pp | +12.50pp | n/a | n/a | 45.83% (11/24) | +12.50pp |
Environment: DEV
E2E Jobs
349
Success Rate
51.00%
Provision success
Provisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step.64.11% (209/326)
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.85.17% (178/209)
E2E Jobs (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. This card shows the number of runs in that DEV-only goal basis.197
Success Rate (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. This card shows the overall success rate for that DEV-only goal basis.62.44%
Provision success (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. Provisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step.68.23% (131/192)
E2E success (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.93.89% (123/131)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
Daily Run Outcomes for DEV Goal Basis (post-good + batches)
Successful runs (post-good + batches)
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 57.89% | 19 | rp-api-compat-all/parallel | Engineering should be able to retrieve expected metrics from the /metrics endpoint | |
| 74.44% | 313 | step graph | Run pipeline step Microsoft.Azure.ARO.HCP.Region/regional/infra | |
| 94.69% | 113 | rp-api-compat-all/parallel | Customer should not be able to perform various invalid operations on cluster resources |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.Authorizationfull failure pattern: ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.Authorization Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | provision | 92 | 26.36%92 of 349 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 1: 0 · Mar 2: 22 · Mar 3: 21 · Mar 4: 35 · Mar 5: 14 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)time=2026-03-05T18:59:54.847Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-03-05T18:59:56.517Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-03-05T18:59:57.630Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=829db07553358e04ba6f1974ce4382138f4ed683bf2846b0fd1f28bcc23e2098
time=2026-03-05T19:01:58.722Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j6003968/providers/Microsoft.Resources/deployments/829db07553358e04ba6f1974ce4382138f4ed683bf2846b0fd1f28bcc23e2098/operationStatuses/08584288696885440870\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j6003968/providers/Microsoft.Resources/deployments/svc-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j6003968/providers/Microsoft.Monitor/accounts/services-j6003968/providers/Microsoft.Authorization/roleAssignments/b92119a1-893c-5d44-8e94-8017dcd14434\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T190018Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'f8034c64-29df-4a64-a87d-1e6b3d8a13de', request correlation id 'a537b1c5-5960-4794-9504-fdb91cfb0c64'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"time=2026-03-05T15:56:11.735Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-03-05T15:56:13.671Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-03-05T15:56:14.913Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=ed84426758cbbb353371a9235a496758b8f3e98aa625c265db09a4e3e29cda2c
time=2026-03-05T15:58:15.933Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j7455488/providers/Microsoft.Resources/deployments/ed84426758cbbb353371a9235a496758b8f3e98aa625c265db09a4e3e29cda2c/operationStatuses/08584288807112291690\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Resources/deployments/hcp-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Monitor/accounts/hcps-j7455488/providers/Microsoft.Authorization/roleAssignments/caa896f1-1d74-5c65-824e-d46f9b44719f\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T155635Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '6e38dbe3-68e4-4adb-b4dc-72161e062672', request correlation id '1056ad0c-dd70-4639-a07e-4effd484f439'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n },\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Resources/deployments/svc-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j7455488/providers/Microsoft.Monitor/accounts/services-j7455488/providers/Microsoft.Authorization/roleAssignments/fb67040b-742c-5416-bfc1-eb6a3205318d\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T155628Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id '83a7fc85-9a1f-4ce7-a764-3f5342de9960', request correlation id '1056ad0c-dd70-4639-a07e-4effd484f439'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"time=2026-03-05T15:54:30.586Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-03-05T15:54:32.976Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-03-05T15:54:34.248Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=a89c2c923545ab2245aae3e95f8c1e0e15fd41c82d7aa26d45863bc410cd51f2
time=2026-03-05T15:56:35.445Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j4296704/providers/Microsoft.Resources/deployments/a89c2c923545ab2245aae3e95f8c1e0e15fd41c82d7aa26d45863bc410cd51f2/operationStatuses/08584288808119232283\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j4296704/providers/Microsoft.Resources/deployments/svc-monitor\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j4296704/providers/Microsoft.Monitor/accounts/services-j4296704/providers/Microsoft.Authorization/roleAssignments/f804a3aa-59ee-5d3f-8e21-9cd520cda0fb\\\",\\r\\n \\\"message\\\": \\\"Encountered internal server error. Diagnostic information: timestamp '20260305T155449Z', subscription id 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', tracking id 'a38e6fcf-aa35-42d4-ba05-70159e9be81c', request correlation id 'a8ffd35f-99a4-4c58-952a-d6ac85d98793'.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"Contributing tests (1)
Affected runs (92) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not foundfull failure pattern: failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 9 | 2.58%9 of 349 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 3 · Mar 3: 6 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000e283c0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b30960>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000e283c0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b30960>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc00090f2a0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000c660a0>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc00090f2a0>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000c660a0>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000587040>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b62780>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/exporter_metrics.go:70]: Failed to find exporter pod
Unexpected error:
<*fmt.wrapError | 0xc000587040>:
failed to get service aro-hcp-exporter/aro-hcp-exporter: services "aro-hcp-exporter" not found
{
msg: "failed to get service aro-hcp-exporter/aro-hcp-exporter: services \"aro-hcp-exporter\" not found",
err: <*errors.StatusError | 0xc000b62780>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "services \"aro-hcp-exporter\" not found",
Reason: "NotFound",
Details: {
Name: "aro-hcp-exporter",
Group: "",
Kind: "services",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
occurredContributing tests (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: NoiseSignal: Noise — source deserialization/no-output error | e2e | 6 | 1.72%6 of 349 job runs affected | NoiseSignal: Noise — source deserialization/no-output error | Show trend detailsMar 1: 1 · Mar 2: 3 · Mar 3: 2 · Mar 4: 2 · Mar 5: 2 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3):284
> github.com/Azure/ARO-HCP/test/e2e.init.func16.2({0x7f9950e14260, 0xc00071d920})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8222980?, 0xc00071d920?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 91
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/05/26 19:51:01.879
"ts"="2026-03-05 19:51:01.879639" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 19:51:01.879740" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-wdnsms" "resourceGroup"="customer-rg-z2vc29"
"ts"="2026-03-05 19:51:02.856126" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-wdnsms" "resourceGroup"=""
"ts"="2026-03-05 19:51:03.876876" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-lfq9wm" "resourceGroup"="customer-rg-z2vc29"
"ts"="2026-03-05 19:51:04.021245" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-lfq9wm" "resourceGroup"=""
"ts"="2026-03-05 19:51:04.831197" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 19:51:04.831315" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 19:51:04.831390" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 19:51:04.833064" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-160"
"ts"="2026-03-05 19:51:04.833097" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-91"
"ts"="2026-03-05 19:51:04.833131" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-z2vc29"
"ts"="2026-03-05 19:51:04.833088" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-297"
"ts"="2026-03-05 19:51:05.359625" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-91" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:05.745001" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-160" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:06.201250" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-05 19:51:06.623151" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-297" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:06.990038" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-91" "deployment"="msi-deployment-91"
"ts"="2026-03-05 19:51:07.388213" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-160" "deployment"="msi-deployment-160"
"ts"="2026-03-05 19:51:07.781171" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="customer-infra-basic-hcp-cluster2-lfq9wm"
"ts"="2026-03-05 19:51:08.151736" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-297" "deployment"="msi-deployment-297"
"ts"="2026-03-05 19:51:09.473452" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-05 19:51:10.117976" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="customer-infra-basic-hcp-cluster-wdnsms"
"ts"="2026-03-05 19:51:10.638792" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 19:51:10.638932" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 19:51:10.639040" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-z2vc29"
Command Error: signal: killed
Deserializaion Error: no output from command
:284
> github.com/Azure/ARO-HCP/test/e2e.init.func16.2({0x7f9950e14260, 0xc00071d920})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8222980?, 0xc00071d920?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 91
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/05/26 19:51:01.879
"ts"="2026-03-05 19:51:01.879639" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 19:51:01.879740" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-wdnsms" "resourceGroup"="customer-rg-z2vc29"
"ts"="2026-03-05 19:51:02.856126" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-wdnsms" "resourceGroup"=""
"ts"="2026-03-05 19:51:03.876876" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-lfq9wm" "resourceGroup"="customer-rg-z2vc29"
"ts"="2026-03-05 19:51:04.021245" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-lfq9wm" "resourceGroup"=""
"ts"="2026-03-05 19:51:04.831197" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 19:51:04.831315" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 19:51:04.831390" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 19:51:04.833064" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-160"
"ts"="2026-03-05 19:51:04.833097" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-91"
"ts"="2026-03-05 19:51:04.833131" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-z2vc29"
"ts"="2026-03-05 19:51:04.833088" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-297"
"ts"="2026-03-05 19:51:05.359625" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-91" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:05.745001" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-160" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:06.201250" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-05 19:51:06.623151" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-297" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:06.990038" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-91" "deployment"="msi-deployment-91"
"ts"="2026-03-05 19:51:07.388213" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-160" "deployment"="msi-deployment-160"
"ts"="2026-03-05 19:51:07.781171" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="customer-infra-basic-hcp-cluster2-lfq9wm"
"ts"="2026-03-05 19:51:08.151736" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-297" "deployment"="msi-deployment-297"
"ts"="2026-03-05 19:51:09.473452" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-05 19:51:10.117976" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-z2vc29" "deployment"="customer-infra-basic-hcp-cluster-wdnsms"
"ts"="2026-03-05 19:51:10.638792" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 19:51:10.638932" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 19:51:10.639040" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-z2vc29"
Command Error: signal: killed
Deserializaion Error: no output from commandprogress report:
Customer should respect cluster-wide node limits with nodepool autoscaling (Spec Runtime: 1h29m59.829s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122
In [It] (Node Runtime: 1h29m59.829s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122
At [By Step] creating cluster with MaxNodesTotal limit (Step Runtime: 45m53.738s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:143
Spec Goroutine
goroutine 100 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x820d118, 0xc000ab84b0}, 0x77f2f7b?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x823ff60, {0x820d118, 0xc000ab84b0}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x820d188?, 0xc0001ee2a0?}, {{0x82228a8?, 0xc00088d280?}, 0xc001450970?}, 0xc000ff5810, {0xc00023fa70, 0x16}, {0x780eccd, 0x12}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d3694, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func23.3({0x7fcf776a4250, 0xc0009062a0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:160
| Expect(err).NotTo(HaveOccurred())
|
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8222980?, 0xc0009062a0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 65
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166 @ 03/05/26 19:51:01.88
"ts"="2026-03-05 19:51:01.880734" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 19:51:01.880823" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-node-limit-cluster-fphxbn" "resourceGroup"="node-limit-test-plc8qm"
"ts"="2026-03-05 19:51:02.813337" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-node-limit-cluster-fphxbn" "resourceGroup"=""
"ts"="2026-03-05 19:51:03.675003" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz"
"ts"="2026-03-05 19:51:03.675102" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz"
"ts"="2026-03-05 19:51:03.675170" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 19:51:03.676249" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-204"
"ts"="2026-03-05 19:51:03.676262" "level"=0 "msg"="collecting deployments" "resourceGroup"="node-limit-test-plc8qm"
"ts"="2026-03-05 19:51:04.225946" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-204" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:04.623087" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-plc8qm" "deployment"="pooledNonMsiScopedAssignments-j6nw3ohx7bzo4"
"ts"="2026-03-05 19:51:04.982469" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-204" "deployment"="msi-deployment-204"
"ts"="2026-03-05 19:51:05.382145" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-plc8qm" "deployment"="customer-infra-node-limit-cluster-fphxbn"
"ts"="2026-03-05 19:51:06.229898" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 19:51:06.230046" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 19:51:06.230202" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="node-limit-test-plc8qm"
Command Error: signal: killed
Deserializaion Error: no output from command
progress report:
Customer should respect cluster-wide node limits with nodepool autoscaling (Spec Runtime: 1h29m59.829s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122
In [It] (Node Runtime: 1h29m59.829s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:122
At [By Step] creating cluster with MaxNodesTotal limit (Step Runtime: 45m53.738s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:143
Spec Goroutine
goroutine 100 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x820d118, 0xc000ab84b0}, 0x77f2f7b?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x823ff60, {0x820d118, 0xc000ab84b0}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x820d188?, 0xc0001ee2a0?}, {{0x82228a8?, 0xc00088d280?}, 0xc001450970?}, 0xc000ff5810, {0xc00023fa70, 0x16}, {0x780eccd, 0x12}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d3694, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func23.3({0x7fcf776a4250, 0xc0009062a0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:160
| Expect(err).NotTo(HaveOccurred())
|
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8222980?, 0xc0009062a0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 65
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166 @ 03/05/26 19:51:01.88
"ts"="2026-03-05 19:51:01.880734" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 19:51:01.880823" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-node-limit-cluster-fphxbn" "resourceGroup"="node-limit-test-plc8qm"
"ts"="2026-03-05 19:51:02.813337" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-node-limit-cluster-fphxbn" "resourceGroup"=""
"ts"="2026-03-05 19:51:03.675003" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz"
"ts"="2026-03-05 19:51:03.675102" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-133f4b3b85cd881bd2d7025c4df814bf698b577d4462803137df4f5ac0cf68e9.yaml.gz"
"ts"="2026-03-05 19:51:03.675170" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 19:51:03.676249" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-204"
"ts"="2026-03-05 19:51:03.676262" "level"=0 "msg"="collecting deployments" "resourceGroup"="node-limit-test-plc8qm"
"ts"="2026-03-05 19:51:04.225946" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-204" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 19:51:04.623087" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-plc8qm" "deployment"="pooledNonMsiScopedAssignments-j6nw3ohx7bzo4"
"ts"="2026-03-05 19:51:04.982469" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-204" "deployment"="msi-deployment-204"
"ts"="2026-03-05 19:51:05.382145" "level"=0 "msg"="collecting operations" "resourceGroup"="node-limit-test-plc8qm" "deployment"="customer-infra-node-limit-cluster-fphxbn"
"ts"="2026-03-05 19:51:06.229898" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 19:51:06.230046" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 19:51:06.230202" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="node-limit-test-plc8qm"
Command Error: signal: killed
Deserializaion Error: no output from command> github.com/Azure/ARO-HCP/test/e2e.init.func16.2({0x7fbe2ee580b0, 0xc0008f0ea0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc0008f0ea0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 85
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/04/26 12:20:17.181
"ts"="2026-03-04 12:20:17.181376" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-04 12:20:17.181449" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-r8299g" "resourceGroup"="customer-rg-fmprdk"
"ts"="2026-03-04 12:20:17.754133" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-r8299g" "resourceGroup"=""
"ts"="2026-03-04 12:20:18.618579" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-gt5nj2" "resourceGroup"="customer-rg-fmprdk"
"ts"="2026-03-04 12:20:18.844790" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-gt5nj2" "resourceGroup"=""
"ts"="2026-03-04 12:20:19.791630" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-04 12:20:19.791746" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-04 12:20:19.791815" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-04 12:20:19.792915" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-108"
"ts"="2026-03-04 12:20:19.792942" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-124"
"ts"="2026-03-04 12:20:19.792927" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-136"
"ts"="2026-03-04 12:20:19.792966" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-fmprdk"
"ts"="2026-03-04 12:20:20.465045" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-108" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-04 12:20:20.752891" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-124" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-04 12:20:21.092977" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-136" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-04 12:20:21.529002" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-04 12:20:21.896103" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-108" "deployment"="msi-deployment-108"
"ts"="2026-03-04 12:20:22.262610" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-124" "deployment"="msi-deployment-124"
"ts"="2026-03-04 12:20:22.786160" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-136" "deployment"="msi-deployment-136"
"ts"="2026-03-04 12:20:22.976200" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="customer-infra-basic-hcp-cluster2-gt5nj2"
"ts"="2026-03-04 12:20:24.393749" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-04 12:20:24.855086" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="customer-infra-basic-hcp-cluster-r8299g"
"ts"="2026-03-04 12:20:25.388961" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-04 12:20:25.389089" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-04 12:20:25.389193" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-fmprdk"
Command Error: signal: killed
Deserializaion Error: no output from command
> github.com/Azure/ARO-HCP/test/e2e.init.func16.2({0x7fbe2ee580b0, 0xc0008f0ea0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
|
| By("waiting for first cluster to complete creation")
> _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc0008f0ea0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 85
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 03/04/26 12:20:17.181
"ts"="2026-03-04 12:20:17.181376" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-04 12:20:17.181449" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-r8299g" "resourceGroup"="customer-rg-fmprdk"
"ts"="2026-03-04 12:20:17.754133" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-r8299g" "resourceGroup"=""
"ts"="2026-03-04 12:20:18.618579" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-gt5nj2" "resourceGroup"="customer-rg-fmprdk"
"ts"="2026-03-04 12:20:18.844790" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-gt5nj2" "resourceGroup"=""
"ts"="2026-03-04 12:20:19.791630" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-04 12:20:19.791746" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-04 12:20:19.791815" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-04 12:20:19.792915" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-108"
"ts"="2026-03-04 12:20:19.792942" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-124"
"ts"="2026-03-04 12:20:19.792927" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-136"
"ts"="2026-03-04 12:20:19.792966" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-fmprdk"
"ts"="2026-03-04 12:20:20.465045" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-108" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-04 12:20:20.752891" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-124" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-04 12:20:21.092977" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-136" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-04 12:20:21.529002" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-04 12:20:21.896103" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-108" "deployment"="msi-deployment-108"
"ts"="2026-03-04 12:20:22.262610" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-124" "deployment"="msi-deployment-124"
"ts"="2026-03-04 12:20:22.786160" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-136" "deployment"="msi-deployment-136"
"ts"="2026-03-04 12:20:22.976200" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="customer-infra-basic-hcp-cluster2-gt5nj2"
"ts"="2026-03-04 12:20:24.393749" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-04 12:20:24.855086" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fmprdk" "deployment"="customer-infra-basic-hcp-cluster-r8299g"
"ts"="2026-03-04 12:20:25.388961" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-04 12:20:25.389089" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-04 12:20:25.389193" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-fmprdk"
Command Error: signal: killed
Deserializaion Error: no output from commandContributing tests (4)
Affected runs (6) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 5 | 1.43%5 of 349 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 1: 0 · Mar 2: 30 · Mar 3: 12 · Mar 4: 16 · Mar 5: 12 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | INT, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
<*fmt.wrapErrors | 0xc00133d5f0>:
failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-hmsxvp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: context deadline exceeded
{
msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-hmsxvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00109fae0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp",
},
<*fmt.wrapErrors | 0xc00133d5c0>{
msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-hmsxvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00109fae0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
<*fmt.wrapErrors | 0xc00133d5f0>:
failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-hmsxvp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: context deadline exceeded
{
msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-hmsxvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00109fae0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp",
},
<*fmt.wrapErrors | 0xc00133d5c0>{
msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-hmsxvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00109fae0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-hmsxvp",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error:
<*fmt.wrapErrors | 0xc00120b2c0>:
failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-mn7k92" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: context deadline exceeded
{
msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mn7k92\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013e3bc0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92",
},
<*fmt.wrapErrors | 0xc00120b290>{
msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mn7k92\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013e3bc0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error:
<*fmt.wrapErrors | 0xc00120b2c0>:
failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-mn7k92" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: context deadline exceeded
{
msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mn7k92\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013e3bc0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92",
},
<*fmt.wrapErrors | 0xc00120b290>{
msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-mn7k92\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0013e3bc0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-mn7k92",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc001053530>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-f5ctsq" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-f5ctsq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000fbd7d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq",
},
<*fmt.wrapErrors | 0xc001053500>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-f5ctsq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000fbd7d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc001053530>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-f5ctsq" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-f5ctsq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000fbd7d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq",
},
<*fmt.wrapErrors | 0xc001053500>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-f5ctsq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000fbd7d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-f5ctsq",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (18)
Affected runs (5) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 4 | 1.15%4 of 349 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 3 · Mar 7: 0 · Mar 8: 0 | PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapError | 0xc0004ad3a0>:
failed to start credential request: POST https://rp.j1819776.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j1819776.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0004af260>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"9b996da8-365a-4889-babb-69a651bc41a4",
],
"Date": [
"Fri, 06 Mar 2026 23:22:56 GMT",
],
"Content-Length": ["319"],
"X-Envoy-Upstream-Service-Time": ["24"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
},
Body: <*exported.nopClosingBytesReader | 0xc0004ad2c0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 101, 120, 116, 101, 114, 110, 97, 108, 45, 97, 117, 116, 104, 45, 99, 108, 117, 115, 116, 101, 114, 45, 119, 57, 120, 52, 99, 104, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 101, 97, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 319,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1819776.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-clu...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapError | 0xc0004ad3a0>:
failed to start credential request: POST https://rp.j1819776.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j1819776.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0004af260>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"9b996da8-365a-4889-babb-69a651bc41a4",
],
"Date": [
"Fri, 06 Mar 2026 23:22:56 GMT",
],
"Content-Length": ["319"],
"X-Envoy-Upstream-Service-Time": ["24"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
},
Body: <*exported.nopClosingBytesReader | 0xc0004ad2c0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 101, 120, 116, 101, 114, 110, 97, 108, 45, 97, 117, 116, 104, 45, 99, 108, 117, 115, 116, 101, 114, 45, 119, 57, 120, 52, 99, 104, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 101, 97, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 319,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1819776.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-w9x4ch/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-clu...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc000ff0e60>:
failed to start credential request: POST https://rp.j7154944.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j7154944.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000a6c960>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"c9d75051-617e-4aa3-b30e-9c2ddcda3e13",
],
"Date": [
"Fri, 06 Mar 2026 14:56:53 GMT",
],
"Content-Length": ["316"],
"X-Envoy-Upstream-Service-Time": ["21"],
},
Body: <*exported.nopClosingBytesReader | 0xc000ff0d20>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 104, 55, 108, 122, 104, 116, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 316,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j7154944.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredent...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc000ff0e60>:
failed to start credential request: POST https://rp.j7154944.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j7154944.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000a6c960>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"c9d75051-617e-4aa3-b30e-9c2ddcda3e13",
],
"Date": [
"Fri, 06 Mar 2026 14:56:53 GMT",
],
"Content-Length": ["316"],
"X-Envoy-Upstream-Service-Time": ["21"],
},
Body: <*exported.nopClosingBytesReader | 0xc000ff0d20>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 104, 55, 108, 122, 104, 116, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 112, 97, 116, 99, 104, 45, 116, 97, 103, 115, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 316,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j7154944.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-h7lzht/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredent...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:92]: Unexpected error:
<*fmt.wrapError | 0xc00011edc0>:
failed to start credential request: POST https://rp.j8137600.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j8137600.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0010bd290>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["336"],
"X-Envoy-Upstream-Service-Time": ["4045"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"3bd9c5e5-6664-4f0e-8899-2597fb72437a",
],
"Date": [
"Fri, 06 Mar 2026 06:23:28 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00011eac0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 56, 50, 114, 100, 107, 57, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 104, 99, 112, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 336,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j8137600.hcpsvc.osadev.cloud",
Path: "/subscriptions/974ebd46-8ad3-41e3-afef-7...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:92]: Unexpected error:
<*fmt.wrapError | 0xc00011edc0>:
failed to start credential request: POST https://rp.j8137600.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://rp.j8137600.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-82rdk9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-update-nodes-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0010bd290>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["336"],
"X-Envoy-Upstream-Service-Time": ["4045"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"3bd9c5e5-6664-4f0e-8899-2597fb72437a",
],
"Date": [
"Fri, 06 Mar 2026 06:23:28 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00011eac0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 56, 50, 114, 100, 107, 57, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 104, 99, 112, 79, 112, 101, 110, 83, 104, 105, 102, 116, 67, 108, 117, 115, 116, 101, 114, 115, 47, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 104, 99, 112, 45, 99, 108, 117, 115, 116, 101, 114, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 336,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "POST",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j8137600.hcpsvc.osadev.cloud",
Path: "/subscriptions/974ebd46-8ad3-41e3-afef-7...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (3)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 5 day(s) | e2e | 4 | 1.15%4 of 349 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 5 day(s) | Show trend detailsMar 1: 1 · Mar 2: 1 · Mar 3: 0 · Mar 4: 1 · Mar 5: 1 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 | INT, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Environment: INT
E2E Jobs
31
Success Rate
45.16%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.45.16% (14/31)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 69.70% | 33 | integration/parallel | Customer should be able to create an HCP cluster | |
| 69.70% | 33 | integration/parallel | Customer should be able to create an HCP cluster with custom autoscaling | |
| 72.73% | 33 | integration/parallel | Customer should be able to create an HCP cluster and custom node pool osDisk size | |
| 72.73% | 33 | integration/parallel | Customer should be able to create an HCP cluster with back-level version 4.19 | |
| 72.73% | 33 | integration/parallel | Customer should be able to create node pools with ARM64-based VMs |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | e2e | 5 | 16.13%5 of 31 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | Show trend detailsMar 1: 0 · Mar 2: 14 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 16 · Mar 8: 42 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapErrors | 0xc0012244b0>:
failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t9q8pb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: context deadline exceeded
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9q8pb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014cd940>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb",
},
<*fmt.wrapErrors | 0xc001224480>{
msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9q8pb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014cd940>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapErrors | 0xc0012244b0>:
failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-t9q8pb" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: context deadline exceeded
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9q8pb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014cd940>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb",
},
<*fmt.wrapErrors | 0xc001224480>{
msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-t9q8pb\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0014cd940>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-t9q8pb",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapErrors | 0xc00113aa50>:
failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-jl725c" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: context deadline exceeded
{
msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-jl725c\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0010fb4d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c",
},
<*fmt.wrapErrors | 0xc00113aa20>{
msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-jl725c\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0010fb4d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapErrors | 0xc00113aa50>:
failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-jl725c" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: context deadline exceeded
{
msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-jl725c\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0010fb4d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c",
},
<*fmt.wrapErrors | 0xc00113aa20>{
msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-jl725c\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0010fb4d0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-jl725c",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
<*fmt.wrapErrors | 0xc000fea2d0>:
failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-gvbqvc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: context deadline exceeded
{
msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-gvbqvc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f72440>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc",
},
<*fmt.wrapErrors | 0xc000fea2a0>{
msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-gvbqvc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f72440>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
<*fmt.wrapErrors | 0xc000fea2d0>:
failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-gvbqvc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: context deadline exceeded
{
msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-gvbqvc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f72440>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc",
},
<*fmt.wrapErrors | 0xc000fea2a0>{
msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-gvbqvc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f72440>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-gvbqvc",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (18)
Affected runs (5)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed waiting for deployment "aro-hcp-demo" in resourcegroup="<resource-group>" to finish: context deadline exceededfull failure pattern: failed waiting for deployment "aro-hcp-demo" in resourcegroup="<resource-group>" to finish: context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 5 | 16.13%5 of 31 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 1: 2 · Mar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 1 · Mar 8: 3 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc00130a2e0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-2v2fc9" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-2v2fc9\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc00130a2e0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-2v2fc9" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-2v2fc9\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000e301a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-r9kx6m" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-r9kx6m\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000e301a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-r9kx6m" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-r9kx6m\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000efa380>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-m27vw4" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-m27vw4\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc000efa380>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-m27vw4" to finish: context deadline exceeded
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-m27vw4\" to finish: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredContributing tests (1)
Affected runs (5)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: NoiseSignal: Noise — source deserialization/no-output error — New failure pattern — no prior history | e2e | 4 | 12.90%4 of 31 job runs affected | NoiseSignal: Noise — source deserialization/no-output error — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 3 · Mar 8: 14 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)ess report:
Customer should be able to create a cluster with an external auth config and get the external auth config (Spec Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
In [It] (Node Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
At [By Step] creating the HCP cluster (Step Runtime: 23m7.947s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:86
Spec Goroutine
goroutine 83 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000e984b0}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000e984b0}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0007184d0?}, {{0x8229828?, 0xc000f8ec00?}, 0xc0014a10f0?}, 0xc000095460, {0xc001686080, 0x1c}, {0x77f1061, 0xa}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fe87c4e9260, 0xc000e0a900})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:87
|
| By("creating the HCP cluster")
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e0a900?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 80
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93 @ 03/09/26 00:55:48.983
"ts"="2026-03-09 00:55:48.983513" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:48.983579" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-ea-cluster-lhqv9g" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:49.269384" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-ea-cluster-lhqv9g" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.373231" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373342" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373399" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.374388" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-93"
"ts"="2026-03-09 00:55:50.374406" "level"=0 "msg"="collecting deployments" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:50.548442" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="pooledNonMsiScopedAssignments-ltdphft7fgrwg"
"ts"="2026-03-09 00:55:50.625278" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.704199" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="customer-infra-ea-cluster-lhqv9g"
"ts"="2026-03-09 00:55:50.773364" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="msi-deployment-93"
"ts"="2026-03-09 00:55:50.914401" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:50.914511" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:50.914617" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="external-auth-cluster-mzjzr2"
Command Error: signal: killed
Deserializaion Error: no output from command
ess report:
Customer should be able to create a cluster with an external auth config and get the external auth config (Spec Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
In [It] (Node Runtime: 1h29m59.863s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47
At [By Step] creating the HCP cluster (Step Runtime: 23m7.947s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:86
Spec Goroutine
goroutine 83 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000e984b0}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000e984b0}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0007184d0?}, {{0x8229828?, 0xc000f8ec00?}, 0xc0014a10f0?}, 0xc000095460, {0xc001686080, 0x1c}, {0x77f1061, 0xa}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fe87c4e9260, 0xc000e0a900})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:87
|
| By("creating the HCP cluster")
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e0a900?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 80
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93 @ 03/09/26 00:55:48.983
"ts"="2026-03-09 00:55:48.983513" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:48.983579" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-ea-cluster-lhqv9g" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:49.269384" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-ea-cluster-lhqv9g" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.373231" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373342" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-5cf63771ae62e0f954d80324422e91fa0bb45dd988e9775341d966a9f013200c.yaml.gz"
"ts"="2026-03-09 00:55:50.373399" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.374388" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-93"
"ts"="2026-03-09 00:55:50.374406" "level"=0 "msg"="collecting deployments" "resourceGroup"="external-auth-cluster-mzjzr2"
"ts"="2026-03-09 00:55:50.548442" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="pooledNonMsiScopedAssignments-ltdphft7fgrwg"
"ts"="2026-03-09 00:55:50.625278" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.704199" "level"=0 "msg"="collecting operations" "resourceGroup"="external-auth-cluster-mzjzr2" "deployment"="customer-infra-ea-cluster-lhqv9g"
"ts"="2026-03-09 00:55:50.773364" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-93" "deployment"="msi-deployment-93"
"ts"="2026-03-09 00:55:50.914401" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:50.914511" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:50.914617" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="external-auth-cluster-mzjzr2"
Command Error: signal: killed
Deserializaion Error: no output from command/ARO-HCP/test/e2e/cluster_list_no_infra.go:79
Spec Goroutine
goroutine 76 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000c06a00}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000c06a00}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0014ae5b0?}, {{0x8229828?, 0xc000f10400?}, 0xc001315150?}, 0xc0000954d8, {0xc0017180c0, 0x16}, {0xc001718108, 0x18}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func9.1({0x7fc3e407da20, 0xc000e9a4b0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:80
|
| By("creating HCP cluster: " + clusterName)
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e9a4b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 105
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86 @ 03/09/26 00:55:49.002
"ts"="2026-03-09 00:55:49.002403" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.002460" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:49.170511" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.720443" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720526" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720575" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.721543" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-35"
"ts"="2026-03-09 00:55:50.721556" "level"=0 "msg"="collecting deployments" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:50.721574" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-68"
"ts"="2026-03-09 00:55:50.869107" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="pooledNonMsiScopedAssignments-uiliqvnffsucw"
"ts"="2026-03-09 00:55:50.889358" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.015471" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.094004" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="msi-deployment-68"
"ts"="2026-03-09 00:55:51.164853" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="msi-deployment-35"
"ts"="2026-03-09 00:55:51.208118" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw"
"ts"="2026-03-09 00:55:51.362721" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.362834" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.362929" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="cluster-listing-tvdjtg"
Command Error: signal: killed
Deserializaion Error: no output from command
/ARO-HCP/test/e2e/cluster_list_no_infra.go:79
Spec Goroutine
goroutine 76 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc000c06a00}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc000c06a00}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc0014ae5b0?}, {{0x8229828?, 0xc000f10400?}, 0xc001315150?}, 0xc0000954d8, {0xc0017180c0, 0x16}, {0xc001718108, 0x18}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func9.1({0x7fc3e407da20, 0xc000e9a4b0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:80
|
| By("creating HCP cluster: " + clusterName)
> err = tc.CreateHCPClusterFromParam(ctx,
| GinkgoLogr,
| *resourceGroup.Name,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000e9a4b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 105
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86 @ 03/09/26 00:55:49.002
"ts"="2026-03-09 00:55:49.002403" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.002460" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:49.170511" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-list-test-cluster-tvrz8c-rflwvw" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.720443" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720526" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b860a86958f57179c37d87e5f83be5384f83e5bf95c88d961f55ca4e4ca1bbbb.yaml.gz"
"ts"="2026-03-09 00:55:50.720575" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.721543" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-35"
"ts"="2026-03-09 00:55:50.721556" "level"=0 "msg"="collecting deployments" "resourceGroup"="cluster-listing-tvdjtg"
"ts"="2026-03-09 00:55:50.721574" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-68"
"ts"="2026-03-09 00:55:50.869107" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="pooledNonMsiScopedAssignments-uiliqvnffsucw"
"ts"="2026-03-09 00:55:50.889358" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.015471" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:51.094004" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-68" "deployment"="msi-deployment-68"
"ts"="2026-03-09 00:55:51.164853" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-35" "deployment"="msi-deployment-35"
"ts"="2026-03-09 00:55:51.208118" "level"=0 "msg"="collecting operations" "resourceGroup"="cluster-listing-tvdjtg" "deployment"="customer-infra-list-test-cluster-tvrz8c-rflwvw"
"ts"="2026-03-09 00:55:51.362721" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.362834" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.362929" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="cluster-listing-tvdjtg"
Command Error: signal: killed
Deserializaion Error: no output from commandc/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
In [It] (Node Runtime: 1h29m59.889s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
At [By Step] creating the hcp cluster with the image registry disabled (Step Runtime: 23m8.709s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:81
Spec Goroutine
goroutine 96 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc00097e820}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc00097e820}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc00087e8c0?}, {{0x8229828?, 0xc00004b200?}, 0xc00168c378?}, 0xc0000957c8, {0xc0016a0480, 0x1e}, {0x786b387, 0x23}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func20.2({0x7ff1b027fa60, 0xc000c2c8d0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:82
|
| By("creating the hcp cluster with the image registry disabled")
> err = tc.CreateHCPClusterFromParam(
| ctx,
| GinkgoLogr,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000c2c8d0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 93
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89 @ 03/09/26 00:55:49.008
"ts"="2026-03-09 00:55:49.008288" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.008364" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:49.343675" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.681031" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681136" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681197" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.682147" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-17"
"ts"="2026-03-09 00:55:50.682158" "level"=0 "msg"="collecting deployments" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:50.829842" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="pooledNonMsiScopedAssignments-qmh74zogaodhg"
"ts"="2026-03-09 00:55:50.849482" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.963939" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg"
"ts"="2026-03-09 00:55:51.014912" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="msi-deployment-17"
"ts"="2026-03-09 00:55:51.157334" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.157426" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.157531" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="disabled-image-registry-l274nt"
Command Error: signal: killed
Deserializaion Error: no output from command
c/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
In [It] (Node Runtime: 1h29m59.889s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:37
At [By Step] creating the hcp cluster with the image registry disabled (Step Runtime: 23m8.709s)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:81
Spec Goroutine
goroutine 96 [select]
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x8214098, 0xc00097e820}, 0x77f8912?)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x8246e80, {0x8214098, 0xc00097e820}, 0x0)
/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
github.com/Azure/ARO-HCP/test/util/framework.CreateHCPClusterAndWait({0x8214108?, 0xc00087e8c0?}, {{0x8229828?, 0xc00004b200?}, 0xc00168c378?}, 0xc0000957c8, {0xc0016a0480, 0x1e}, {0x786b387, 0x23}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:641
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateHCPClusterFromParam(_, {_, _}, {{_, _}, _}, {_, _}, {{0x77d9018, 0x4}, ...}, ...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:344
> github.com/Azure/ARO-HCP/test/e2e.init.func20.2({0x7ff1b027fa60, 0xc000c2c8d0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:82
|
| By("creating the hcp cluster with the image registry disabled")
> err = tc.CreateHCPClusterFromParam(
| ctx,
| GinkgoLogr,
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8229900?, 0xc000c2c8d0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 93
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89 @ 03/09/26 00:55:49.008
"ts"="2026-03-09 00:55:49.008288" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-09 00:55:49.008364" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:49.343675" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-disabled-image-registry-hcp-cluster-tlvddg" "resourceGroup"=""
"ts"="2026-03-09 00:55:50.681031" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681136" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-f66366cb92003bba305ea6fa81a0011f709bf02a764a23c42e292ad6f9754eee.yaml.gz"
"ts"="2026-03-09 00:55:50.681197" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-09 00:55:50.682147" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-int-17"
"ts"="2026-03-09 00:55:50.682158" "level"=0 "msg"="collecting deployments" "resourceGroup"="disabled-image-registry-l274nt"
"ts"="2026-03-09 00:55:50.829842" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="pooledNonMsiScopedAssignments-qmh74zogaodhg"
"ts"="2026-03-09 00:55:50.849482" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-09 00:55:50.963939" "level"=0 "msg"="collecting operations" "resourceGroup"="disabled-image-registry-l274nt" "deployment"="customer-infra-disabled-image-registry-hcp-cluster-tlvddg"
"ts"="2026-03-09 00:55:51.014912" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-int-17" "deployment"="msi-deployment-17"
"ts"="2026-03-09 00:55:51.157334" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-09 00:55:51.157426" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-09 00:55:51.157531" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="disabled-image-registry-l274nt"
Command Error: signal: killed
Deserializaion Error: no output from commandContributing tests (11)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | e2e | 4 | 12.90%4 of 31 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | Show trend detailsMar 1: 7 · Mar 2: 5 · Mar 3: 0 · Mar 4: 11 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:120]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:120]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:46]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:46]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:39]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:39]: Interrupted by User Contributing tests (12)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | e2e | 4 | 12.90%4 of 31 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 3 day(s) | Show trend detailsMar 1: 2 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 1 · Mar 8: 3 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Test Panickedfull failure pattern: Test Panicked Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 3 | 9.68%3 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 55 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, PROD, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000f66b90?, {0x7fc7e6d7b600?, 0xc0006e6d80?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0004f3320, {0x7fc7e6d7b600, 0xc0006e6d80}, {0xc000f586f0, 0x17}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func20.1({0x7fc7e6d7b600, 0xc0006e6d80})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:74 +0x20a
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc0006e6d80?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 110
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000f66b90?, {0x7fc7e6d7b600?, 0xc0006e6d80?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0004f3320, {0x7fc7e6d7b600, 0xc0006e6d80}, {0xc000f586f0, 0x17}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func20.1({0x7fc7e6d7b600, 0xc0006e6d80})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:74 +0x20a
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc0006e6d80?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 110
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000088910?, {0x7fdcdc31ce00?, 0xc000ac8210?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000860b40, {0x7fdcdc31ce00, 0xc000ac8210}, {0x783a7e5, 0x1b}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func11.1({0x7fdcdc31ce00, 0xc000ac8210})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:49 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ac8210?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 92
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000088910?, {0x7fdcdc31ce00?, 0xc000ac8210?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000860b40, {0x7fdcdc31ce00, 0xc000ac8210}, {0x783a7e5, 0x1b}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func11.1({0x7fdcdc31ce00, 0xc000ac8210})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:49 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ac8210?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 92
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c7c6c0?, {0x7fd105635138?, 0xc00096cae0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0009970e0, {0x7fd105635138, 0xc00096cae0}, {0x77f67a9, 0xd}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fd105635138, 0xc00096cae0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:59 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc00096cae0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 75
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c7c6c0?, {0x7fd105635138?, 0xc00096cae0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0009970e0, {0x7fd105635138, 0xc00096cae0}, {0x77f67a9, 0xd}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func17.2({0x7fd105635138, 0xc00096cae0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:59 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc00096cae0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 75
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test PanickedContributing tests (22)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot update resource while resource is "accepted"; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot update resource while resource is "accepted"; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | e2e | 3 | 9.68%3 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 1 · Mar 8: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0013e8940>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-vbmtkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e8920>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0016c6510>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sun, 08 Mar 2026 02:33:37 GMT",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"96724c91-c0e4-45b4-85cd-edbec338dc84",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/26e3b26d-2515-4027-886c-e494057f0caa",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CC330869501F4FC1B72C45CD3C435C82 Ref B: CHI261140514060 Ref C: 2026-03-08T02:33:37Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["309"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["158"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"281b815b-2dce-4835-ab24-b18fa3f86296",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0013e8940>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-vbmtkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e8920>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-vbmtkg\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-vbmtkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0016c6510>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sun, 08 Mar 2026 02:33:37 GMT",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"96724c91-c0e4-45b4-85cd-edbec338dc84",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/26e3b26d-2515-4027-886c-e494057f0caa",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: CC330869501F4FC1B72C45CD3C435C82 Ref B: CHI261140514060 Ref C: 2026-03-08T02:33:37Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["309"],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["158"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"281b815b-2dce-4835-ab24-b18fa3f86296",
],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0009c8220>:
failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="basic-cluster-lpnmcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009c8200>{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00125e7e0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Sat, 07 Mar 2026 00:17:12 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T001712Z:97607234-1d4e-40a3-b8e5-4aac73aa1e83",
],
"X-Msedge-Ref": [
"Ref A: 8E3A3DDB29E7437B8A99525E6E2E994C Ref B: CH1AA2020603053 Ref C: 2026-03-07T00:17:12Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["311"],
"X-Ms-Request-Id": [
"e1ecbf3e-3dc4-4bd6-b628-f10b7dfdb837",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a8f427fa-8c59-4633-83d9-4928d11132df",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"97607234-1d4e-40a3-b8e5-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0009c8220>:
failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="basic-cluster-lpnmcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009c8200>{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-lpnmcl\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-lpnmcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00125e7e0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Sat, 07 Mar 2026 00:17:12 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T001712Z:97607234-1d4e-40a3-b8e5-4aac73aa1e83",
],
"X-Msedge-Ref": [
"Ref A: 8E3A3DDB29E7437B8A99525E6E2E994C Ref B: CH1AA2020603053 Ref C: 2026-03-07T00:17:12Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["311"],
"X-Ms-Request-Id": [
"e1ecbf3e-3dc4-4bd6-b628-f10b7dfdb837",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/a8f427fa-8c59-4633-83d9-4928d11132df",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"97607234-1d4e-40a3-b8e5-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:99]: Unexpected error:
<*fmt.wrapError | 0xc00093c1a0>:
failed starting cluster creation "admin-cred-lifecycle-gsq42m" in resourcegroup="admin-credential-lifecycle-test-d7rjkq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m"
}
}
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-gsq42m\" in resourcegroup=\"admin-credential-lifecycle-test-d7rjkq\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000a866f0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Correlation-Request-Id": [
"22f6b334-ae72-4d29-abdd-961655511c8b",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T082524Z:22f6b334-ae72-4d29-abdd-961655511c8b",
],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 7189061EF1484B199452D76B6C371785 Ref B: CHI261140504023 Ref C: 2026-03-06T08:25:23Z",
],
"Content-Length": ["339"],
"X-Ms-Request-Id": [
"7936c10a-841b-4aa1-a869-f3b795f66237",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 08:25:24 GMT",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["156"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/30d32c87-7762-49c3-a732-f7cc8a9c64b3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00093c000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 117, 112, 100, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 97, 99, 99, 101, 112, 116, 101, 100, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 52, 102, 48, 54, 49, 57, 102, 45, 101, 98, 99, 50, 45, 52, 49, 53, 54,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:99]: Unexpected error:
<*fmt.wrapError | 0xc00093c1a0>:
failed starting cluster creation "admin-cred-lifecycle-gsq42m" in resourcegroup="admin-credential-lifecycle-test-d7rjkq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot update resource while resource is \"accepted\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m"
}
}
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-gsq42m\" in resourcegroup=\"admin-credential-lifecycle-test-d7rjkq\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot update resource while resource is \\\"accepted\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-d7rjkq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-gsq42m\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000a866f0>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Correlation-Request-Id": [
"22f6b334-ae72-4d29-abdd-961655511c8b",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T082524Z:22f6b334-ae72-4d29-abdd-961655511c8b",
],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["Conflict"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 7189061EF1484B199452D76B6C371785 Ref B: CHI261140504023 Ref C: 2026-03-06T08:25:23Z",
],
"Content-Length": ["339"],
"X-Ms-Request-Id": [
"7936c10a-841b-4aa1-a869-f3b795f66237",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 08:25:24 GMT",
],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["156"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/30d32c87-7762-49c3-a732-f7cc8a9c64b3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc00093c000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 117, 112, 100, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 97, 99, 99, 101, 112, 116, 101, 100, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 52, 102, 48, 54, 49, 57, 102, 45, 101, 98, 99, 50, 45, 52, 49, 53, 54,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (3)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create HCP cluster <cluster>: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:full failure pattern: failed to create HCP cluster <cluster>: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster: Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 6.45%2 of 31 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0008a0960>:
failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc00099a1a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0008a0960>:
failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster hcp-cluster-np-128: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc00099a1a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-111/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc000a8f0c0>:
failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc000883270>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n ...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc000a8f0c0>:
failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:
&armredhatopenshifthcp.HcpOpenShiftCluster{
Location: &"uksouth",
Identity: &{Type: &"UserAssigned", UserAssignedIdentities: {"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane": &{ClientID: &"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a", PrincipalID: &"a5c120f7-50c3-4cf6-84b4-57517f60630d"}, ...}},
Properties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{
... // 8 identical fields
Version: &{ChannelGroup: &"stable", ID: &"4.20"},
Console: nil,
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: {"aro-hcp.experimental.cluster.size-override": &"Minimal"},
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create HCP cluster patch-tags-cluster: operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc000883270>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.HcpOpenShiftCluster:\n &armredhatopenshifthcp.HcpOpenShiftCluster{\n \tLocation: &\"uksouth\",\n \tIdentity: &{Type: &\"UserAssigned\", UserAssignedIdentities: {\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-64/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane\": &{ClientID: &\"f2e4769e-d3c2-498d-92b9-3e6d24cd2d7a\", PrincipalID: &\"a5c120f7-50c3-4cf6-84b4-57517f60630d\"}, ...}},\n \tProperties: &armredhatopenshifthcp.HcpOpenShiftClusterProperties{\n \t\t... // 8 identical fields\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20\"},\n \t\tConsole: nil,\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: {\"aro-hcp.experimental.cluster.size-override\": &\"Minimal\"},\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n ...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tls: failed to verify certificate: x509: certificate signed by unknown authorityfull failure pattern: tls: failed to verify certificate: x509: certificate signed by unknown authority Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 6.45%2 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 1 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000a823a0>:
route host was never found: Get "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc000e42f90>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc000e42f60>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 114, 166, 67, 131, 161, 184, 111, 135, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 23, 13, 50, 55, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 171, 245, 160, 214, 154, 112, 110, 204, 15, 86, 252, 179, 142, 130, 204, 217, 67, 231, 80, 41, 211, 147, 178, 160, 199, 200, 19, 133, 194, 136, 107, 25, 205, 159, 224, 164, 94, 54, 213, 194, 9, 2, 39, 153, 159, 182, 30, 99, 28, 89, 174, 87, 251, 131, 183, 135, 149, 251, 25, 26, 246, 85, 215, 7, 185, 228, 60, 170, 238, 173, 185, 45, 187, 63, 62, 71, 219, 1, 167, 58, 113, 193, 15, 83, 125, 72, 62, 225, 213, 0, 30, 100, 96, 63, 222, 138, 215, 7, 113, 236, 46, 113, 180, 77, 72, 159, 20, 116, 127, 106, 175, 124, 52, 171, 102, 102, 125, 106, 245, 232, 50, 94, 155, 47, 139, 171, 73, 104, 176, 220, 217, 144, 14, 210, 223, 73, 231, 249, 58, 60, 20, 188, 126, 222, 169, 103, 58, 172, 238, 65, 131, 97, 189, 124, 71, 208, 75, 222, 172, 10, 44, 246, 85, 212, 138, 44, 12, 116, 23, 200, 18, 17, 120, 148, 120, 59, 104, 178, 65, 32, 48, 174, 59, 46, 184, 149, 195, 222, 251, 181, 125, 181, 41, 236, 44, 186, 10, 195, 113, 56, 174, 50, 218, 177, 166, 171, 70, 182, 176, 215, 167, 107, 222, 155, 174, 75, 48, 177, 103, 121, 71, 167, 121, 123, 192, 0, 214, 51, 78, 47, 43, 31, 69, 64, 241, 128, 46, 138, 99, 231, 163, 162, 178, 178, 119, 52, 72, 114, 148, 145, 187, 250, 113, 114, 123, 189, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 123, 158, 253, 151, 68, 212, 208, 224, 169, 154, 97, 61, 109, 110, 68, 34, 197, 212, 232, 246, 235, 63, 199, 233, 222, 70, 1, 69, 164, 78, 129, 47, 103, 44, 254, 231, 151, 96, 25, 54, 244, 249, 207, 27, 74, 241, 209, 240, 243, 167, 9, 64, 16, 126, 112, 191, 26, 145, 91, 91, 146, 176, 227, 14, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 34, 251, 31, 200, 232, 181, 131, 228, 184, 123, 9, 109, 121, 91, 57, 62, 121, 66, 56, 146, 252, 19, 141, 227, 187, 163, 111, 151, 181, 203, 103, 196, 33, 174, 179, 90, 65, 140, 89, 118, 141, 231, 147, 48, 92, 72, 18, 147, 42, 112, 172, 42, 69, 190, 39, 18, 54, 32, 31, 52, 39, 133, 120, 237, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 109, 54, 106, 52, 103, 53, 103, 57, 121, 55, 116, 49, 116, 51, 118, 46, 120, 48, 56, 99, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 1, 117, 2, 23, 126, 151, 17, 52, 168, 52, 116, 165, 29, 56, 57, 228, 177, 201, 254, 123, 25...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000a823a0>:
route host was never found: Get "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc000e42f90>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-p8ds6.apps.aro.m6j4g5g9y7t1t3v.x08c.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc000e42f60>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 114, 166, 67, 131, 161, 184, 111, 135, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 23, 13, 50, 55, 48, 51, 48, 54, 48, 56, 50, 54, 53, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 171, 245, 160, 214, 154, 112, 110, 204, 15, 86, 252, 179, 142, 130, 204, 217, 67, 231, 80, 41, 211, 147, 178, 160, 199, 200, 19, 133, 194, 136, 107, 25, 205, 159, 224, 164, 94, 54, 213, 194, 9, 2, 39, 153, 159, 182, 30, 99, 28, 89, 174, 87, 251, 131, 183, 135, 149, 251, 25, 26, 246, 85, 215, 7, 185, 228, 60, 170, 238, 173, 185, 45, 187, 63, 62, 71, 219, 1, 167, 58, 113, 193, 15, 83, 125, 72, 62, 225, 213, 0, 30, 100, 96, 63, 222, 138, 215, 7, 113, 236, 46, 113, 180, 77, 72, 159, 20, 116, 127, 106, 175, 124, 52, 171, 102, 102, 125, 106, 245, 232, 50, 94, 155, 47, 139, 171, 73, 104, 176, 220, 217, 144, 14, 210, 223, 73, 231, 249, 58, 60, 20, 188, 126, 222, 169, 103, 58, 172, 238, 65, 131, 97, 189, 124, 71, 208, 75, 222, 172, 10, 44, 246, 85, 212, 138, 44, 12, 116, 23, 200, 18, 17, 120, 148, 120, 59, 104, 178, 65, 32, 48, 174, 59, 46, 184, 149, 195, 222, 251, 181, 125, 181, 41, 236, 44, 186, 10, 195, 113, 56, 174, 50, 218, 177, 166, 171, 70, 182, 176, 215, 167, 107, 222, 155, 174, 75, 48, 177, 103, 121, 71, 167, 121, 123, 192, 0, 214, 51, 78, 47, 43, 31, 69, 64, 241, 128, 46, 138, 99, 231, 163, 162, 178, 178, 119, 52, 72, 114, 148, 145, 187, 250, 113, 114, 123, 189, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 123, 158, 253, 151, 68, 212, 208, 224, 169, 154, 97, 61, 109, 110, 68, 34, 197, 212, 232, 246, 235, 63, 199, 233, 222, 70, 1, 69, 164, 78, 129, 47, 103, 44, 254, 231, 151, 96, 25, 54, 244, 249, 207, 27, 74, 241, 209, 240, 243, 167, 9, 64, 16, 126, 112, 191, 26, 145, 91, 91, 146, 176, 227, 14, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 34, 251, 31, 200, 232, 181, 131, 228, 184, 123, 9, 109, 121, 91, 57, 62, 121, 66, 56, 146, 252, 19, 141, 227, 187, 163, 111, 151, 181, 203, 103, 196, 33, 174, 179, 90, 65, 140, 89, 118, 141, 231, 147, 48, 92, 72, 18, 147, 42, 112, 172, 42, 69, 190, 39, 18, 54, 32, 31, 52, 39, 133, 120, 237, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 109, 54, 106, 52, 103, 53, 103, 57, 121, 55, 116, 49, 116, 51, 118, 46, 120, 48, 56, 99, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 1, 117, 2, 23, 126, 151, 17, 52, 168, 52, 116, 165, 29, 56, 57, 228, 177, 201, 254, 123, 25...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000990340>:
route host was never found: Get "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc0007be420>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc0007be3f0>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 62, 25, 86, 167, 141, 77, 254, 108, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 23, 13, 50, 55, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 154, 196, 158, 50, 70, 80, 204, 182, 160, 172, 151, 181, 43, 129, 253, 116, 246, 14, 238, 184, 4, 124, 112, 234, 197, 64, 118, 130, 70, 165, 85, 204, 119, 169, 211, 45, 1, 247, 228, 44, 39, 229, 14, 185, 24, 141, 119, 45, 226, 142, 14, 32, 37, 145, 246, 92, 109, 96, 89, 151, 254, 66, 203, 37, 198, 101, 83, 180, 5, 211, 94, 23, 86, 222, 103, 88, 129, 217, 187, 126, 171, 156, 121, 195, 212, 180, 239, 253, 30, 45, 71, 6, 210, 99, 238, 57, 64, 241, 71, 57, 12, 70, 51, 65, 128, 98, 120, 243, 38, 33, 250, 230, 25, 71, 203, 120, 119, 200, 149, 220, 196, 66, 189, 247, 153, 232, 95, 193, 76, 47, 157, 202, 46, 80, 218, 25, 74, 232, 156, 124, 153, 4, 24, 0, 14, 249, 127, 249, 245, 76, 23, 167, 62, 228, 132, 254, 149, 119, 6, 211, 144, 200, 219, 162, 56, 106, 101, 143, 126, 234, 136, 238, 47, 125, 108, 35, 192, 68, 165, 94, 219, 34, 76, 63, 177, 20, 69, 59, 130, 222, 182, 233, 169, 25, 78, 77, 1, 88, 28, 27, 0, 84, 69, 98, 67, 141, 113, 244, 4, 115, 103, 95, 78, 108, 211, 190, 40, 23, 50, 161, 231, 118, 194, 253, 133, 95, 253, 153, 138, 160, 175, 204, 19, 95, 206, 123, 101, 183, 195, 54, 219, 75, 116, 76, 63, 141, 195, 170, 251, 247, 255, 73, 236, 132, 224, 71, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 147, 148, 51, 188, 52, 103, 20, 165, 56, 193, 201, 93, 18, 119, 65, 54, 150, 243, 183, 3, 151, 99, 9, 110, 215, 199, 80, 56, 25, 9, 1, 18, 64, 80, 40, 65, 112, 190, 37, 160, 0, 107, 208, 164, 10, 113, 122, 124, 172, 135, 103, 28, 119, 242, 189, 227, 75, 85, 192, 32, 43, 117, 231, 141, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 243, 119, 37, 142, 132, 226, 104, 177, 2, 226, 195, 219, 230, 16, 46, 175, 130, 189, 157, 67, 86, 226, 172, 98, 47, 7, 28, 93, 189, 9, 171, 122, 8, 57, 89, 195, 140, 227, 185, 222, 202, 237, 239, 107, 152, 109, 113, 52, 177, 66, 65, 94, 2, 246, 138, 40, 181, 44, 74, 137, 16, 188, 152, 212, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 116, 54, 111, 49, 107, 54, 122, 52, 99, 48, 108, 57, 99, 48, 114, 46, 107, 97, 115, 97, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 19, 241, 101, 78, 187, 200, 215, 57, 27, 17, 46, 244, 209, 206, 109, 209, 19, 39, 101, 140, 118, 186, 198, 21, 202, 1,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:193]: Unexpected error:
<*fmt.wrapError | 0xc000990340>:
route host was never found: Get "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc0007be420>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-z2dzw.apps.aro.t6o1k6z4c0l9c0r.kasa.uksouth.aroapp-hcp.azure-test.net",
Err: <*tls.CertificateVerificationError | 0xc0007be3f0>{
UnverifiedCertificates: [
{
Raw: [48, 130, 4, 1, 48, 130, 2, 233, 160, 3, 2, 1, 2, 2, 8, 62, 25, 86, 167, 141, 77, 254, 108, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 23, 13, 50, 55, 48, 51, 48, 53, 50, 48, 52, 56, 48, 56, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 154, 196, 158, 50, 70, 80, 204, 182, 160, 172, 151, 181, 43, 129, 253, 116, 246, 14, 238, 184, 4, 124, 112, 234, 197, 64, 118, 130, 70, 165, 85, 204, 119, 169, 211, 45, 1, 247, 228, 44, 39, 229, 14, 185, 24, 141, 119, 45, 226, 142, 14, 32, 37, 145, 246, 92, 109, 96, 89, 151, 254, 66, 203, 37, 198, 101, 83, 180, 5, 211, 94, 23, 86, 222, 103, 88, 129, 217, 187, 126, 171, 156, 121, 195, 212, 180, 239, 253, 30, 45, 71, 6, 210, 99, 238, 57, 64, 241, 71, 57, 12, 70, 51, 65, 128, 98, 120, 243, 38, 33, 250, 230, 25, 71, 203, 120, 119, 200, 149, 220, 196, 66, 189, 247, 153, 232, 95, 193, 76, 47, 157, 202, 46, 80, 218, 25, 74, 232, 156, 124, 153, 4, 24, 0, 14, 249, 127, 249, 245, 76, 23, 167, 62, 228, 132, 254, 149, 119, 6, 211, 144, 200, 219, 162, 56, 106, 101, 143, 126, 234, 136, 238, 47, 125, 108, 35, 192, 68, 165, 94, 219, 34, 76, 63, 177, 20, 69, 59, 130, 222, 182, 233, 169, 25, 78, 77, 1, 88, 28, 27, 0, 84, 69, 98, 67, 141, 113, 244, 4, 115, 103, 95, 78, 108, 211, 190, 40, 23, 50, 161, 231, 118, 194, 253, 133, 95, 253, 153, 138, 160, 175, 204, 19, 95, 206, 123, 101, 183, 195, 54, 219, 75, 116, 76, 63, 141, 195, 170, 251, 247, 255, 73, 236, 132, 224, 71, 2, 3, 1, 0, 1, 163, 130, 1, 39, 48, 130, 1, 35, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 147, 148, 51, 188, 52, 103, 20, 165, 56, 193, 201, 93, 18, 119, 65, 54, 150, 243, 183, 3, 151, 99, 9, 110, 215, 199, 80, 56, 25, 9, 1, 18, 64, 80, 40, 65, 112, 190, 37, 160, 0, 107, 208, 164, 10, 113, 122, 124, 172, 135, 103, 28, 119, 242, 189, 227, 75, 85, 192, 32, 43, 117, 231, 141, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 243, 119, 37, 142, 132, 226, 104, 177, 2, 226, 195, 219, 230, 16, 46, 175, 130, 189, 157, 67, 86, 226, 172, 98, 47, 7, 28, 93, 189, 9, 171, 122, 8, 57, 89, 195, 140, 227, 185, 222, 202, 237, 239, 107, 152, 109, 113, 52, 177, 66, 65, 94, 2, 246, 138, 40, 181, 44, 74, 137, 16, 188, 152, 212, 48, 76, 6, 3, 85, 29, 17, 4, 69, 48, 67, 130, 65, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 116, 54, 111, 49, 107, 54, 122, 52, 99, 48, 108, 57, 99, 48, 114, 46, 107, 97, 115, 97, 46, 117, 107, 115, 111, 117, 116, 104, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 97, 122, 117, 114, 101, 45, 116, 101, 115, 116, 46, 110, 101, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 19, 241, 101, 78, 187, 200, 215, 57, 27, 17, 46, 244, 209, 206, 109, 209, 19, 39, 101, 140, 118, 186, 198, 21, 202, 1,...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 2 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc000d805d0>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-582s69" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001231ee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69",
},
<*fmt.wrapError | 0xc001534340>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc000d805d0>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-582s69" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001231ee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-582s69",
},
<*fmt.wrapError | 0xc001534340>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-582s69\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapErrors | 0xc001507500>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-c9z2w2" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0009d8fd0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2",
},
<*fmt.wrapError | 0xc000c01760>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapErrors | 0xc001507500>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-c9z2w2" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2, error: failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0009d8fd0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-c9z2w2",
},
<*fmt.wrapError | 0xc000c01760>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-c9z2w2\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredContributing tests (2)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot create resource while parent resource is provisioning; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot create resource while parent resource is provisioning; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapError | 0xc000a811a0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-h5pkc2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a81180>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00085a570>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T005738Z:3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["340"],
"X-Ms-Request-Id": [
"1abae542-ac83-46cd-a1af-21a4bf486bf6",
],
"X-Envoy-Upstream-Service-Time": ["163"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
"X-Msedge-Ref": [
"Ref A: 20FBA6E3D9A14716BDDE02615466306D Ref B: CHI261140505042 Ref C: 2026-03-06T00:57:38Z",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 00:57:38 GMT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error:
<*fmt.wrapError | 0xc000a811a0>:
failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-h5pkc2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot create resource while parent resource is provisioning",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a81180>{
msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-h5pkc2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot create resource while parent resource is provisioning\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-h5pkc2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00085a570>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260306T005738Z:3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["340"],
"X-Ms-Request-Id": [
"1abae542-ac83-46cd-a1af-21a4bf486bf6",
],
"X-Envoy-Upstream-Service-Time": ["163"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
"X-Msedge-Ref": [
"Ref A: 20FBA6E3D9A14716BDDE02615466306D Ref B: CHI261140505042 Ref C: 2026-03-06T00:57:38Z",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"3ee4447e-93c2-4b90-89ff-c264a46fa8bc",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Fri, 06 Mar 2026 00:57:38 GMT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeploymentFailed; detail code TokenNotActive; provider Microsoft.ContainerRegistryfull failure pattern: ERROR CODE: DeploymentFailed; detail code TokenNotActive; provider Microsoft.ContainerRegistry Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc0006285a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-5bhbw5" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"InternalServerError\",\r\n \"message\": \"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: TokenNotActive\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"TokenNotActive\\\",\\n \\\"message\\\": \\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\"\\n },\\n \\\"status\\\": \\\"Failed\\\"\\n}\\n--------------------------------------------------------------------------------\\n\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-5bhbw5\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"InternalServerError\\\",\\r\\n \\\"message\\\": \\\"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\\\n--------------------------------------------------------------------------------\\\\nRESPONSE 409: 409 Conflict\\\\nERROR CODE: TokenNotActive\\\\n--------------------------------------------------------------------------------\\\\n{\\\\n \\\\\\\"error\\\\\\\": {\\\\n \\\\\\\"code\\\\\\\": \\\\\\\"TokenNotActive\\\\\\\",\\\\n \\\\\\\"message\\\\\\\": \\\\\\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\\\\\"\\\\n },\\\\n \\\\\\\"status\\\\\\\": \\\\\\\"Failed\\\\\\\"\\\\n}\\\\n--------------------------------------------------------------------------------\\\\n\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000968600>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-R...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:96]: Unexpected error:
<*fmt.wrapError | 0xc0006285a0>:
failed waiting for deployment "aro-hcp-demo" in resourcegroup="gpu-nodepools-NC4asT4v3-5bhbw5" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeploymentFailed
--------------------------------------------------------------------------------
{
"status": "Failed",
"error": {
"code": "DeploymentFailed",
"message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
"details": [
{
"code": "Conflict",
"message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"InternalServerError\",\r\n \"message\": \"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: TokenNotActive\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"TokenNotActive\\\",\\n \\\"message\\\": \\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\"\\n },\\n \\\"status\\\": \\\"Failed\\\"\\n}\\n--------------------------------------------------------------------------------\\n\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}"
}
]
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for deployment \"aro-hcp-demo\" in resourcegroup=\"gpu-nodepools-NC4asT4v3-5bhbw5\" to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/aro-hcp-demo/operationStatuses/08584290337403915723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.Resources/deployments/cluster\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/gpu-nodepools-NC4asT4v3-5bhbw5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/gpu-nodepool-cluster-nzf27h\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"InternalServerError\\\",\\r\\n \\\"message\\\": \\\"PUT https://management.azure.com/subscriptions/5299e6b7-b23b-46c8-8277-dc1147807117/resourceGroups/global-shared-resources/providers/Microsoft.ContainerRegistry/registries/arohcpocpint/tokens/hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3\\\\n--------------------------------------------------------------------------------\\\\nRESPONSE 409: 409 Conflict\\\\nERROR CODE: TokenNotActive\\\\n--------------------------------------------------------------------------------\\\\n{\\\\n \\\\\\\"error\\\\\\\": {\\\\n \\\\\\\"code\\\\\\\": \\\\\\\"TokenNotActive\\\\\\\",\\\\n \\\\\\\"message\\\\\\\": \\\\\\\"Cannot perform the operation for the token: 'hc-ocp-pull-2oqg82qpbadgc7qk6ce7962c13hk7fm3'. The token is currently in status :'Creating'. For more information on repository permissions, please visit https://aka.ms/acr/repo-permissions.\\\\\\\"\\\\n },\\\\n \\\\\\\"status\\\\\\\": \\\\\\\"Failed\\\\\\\"\\\\n}\\\\n--------------------------------------------------------------------------------\\\\n\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000968600>{
ErrorCode: "DeploymentFailed",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-R...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail code Conflict; detail message A new key vault certificate can not be created or imported while a pending key vault certificate's status is ...full failure pattern: ERROR CODE: InternalServerError; detail code Conflict; detail message A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0009888e0>:
failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-x5k9j9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc",
"name": "2341bf58-c016-4ade-9bc6-f089753ac4bc",
"status": "Failed",
"startTime": "2026-03-03T21:26:33.61172742Z",
"endTime": "2026-03-03T21:31:02.021822414Z",
"error": {
"code": "InternalServerError",
"message": "POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009888c0>{
msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008c4e40>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc0009888e0>:
failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-x5k9j9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc",
"name": "2341bf58-c016-4ade-9bc6-f089753ac4bc",
"status": "Failed",
"startTime": "2026-03-03T21:26:33.61172742Z",
"endTime": "2026-03-03T21:31:02.021822414Z",
"error": {
"code": "InternalServerError",
"message": "POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009888c0>{
msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-x5k9j9\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"name\": \"2341bf58-c016-4ade-9bc6-f089753ac4bc\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:33.61172742Z\",\n \"endTime\": \"2026-03-03T21:31:02.021822414Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"POST https://ah-int-cx-ln-1.vault.azure.net/certificates/kube-apiserver-tls-cert-2oqg829di5lci11n9i8cebdoum5u4cds/create\\n--------------------------------------------------------------------------------\\nRESPONSE 409: 409 Conflict\\nERROR CODE: Conflict\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"Conflict\\\",\\n \\\"message\\\": \\\"A new key vault certificate can not be created or imported while a pending key vault certificate's status is inProgress.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0008c4e40>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message failed to run transaction handler: Managed clusters on AWS need an account claim before installing; provider Microsoft.RedHatOpenSh...full failure pattern: ERROR CODE: InternalServerError; detail message failed to run transaction handler: Managed clusters on AWS need an account claim before installing; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc00088dea0>:
failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-tq9pcx" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232",
"name": "09aabd4d-8689-4a5c-8bb1-c3538510c232",
"status": "Failed",
"startTime": "2026-03-03T21:26:38.133961239Z",
"endTime": "2026-03-03T21:31:47.042145346Z",
"error": {
"code": "InternalServerError",
"message": "failed to run transaction handler: Managed clusters on AWS need an account claim before installing"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00088de80>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001289530>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["25"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/canadaeast/3ffbf395-fb71-49fa-8da8-4aab58175900",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["248"],
"X-Ms-Correlation-Request-Id": [
"e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3748"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 7F476DA1539542E4A76F035388135DE5 Ref B: CHI261140509060 Ref C: 2026-03-03T21:31:49Z",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T213149Z:e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
]...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
<*fmt.wrapError | 0xc00088dea0>:
failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-tq9pcx" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232",
"name": "09aabd4d-8689-4a5c-8bb1-c3538510c232",
"status": "Failed",
"startTime": "2026-03-03T21:26:38.133961239Z",
"endTime": "2026-03-03T21:31:47.042145346Z",
"error": {
"code": "InternalServerError",
"message": "failed to run transaction handler: Managed clusters on AWS need an account claim before installing"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-hcp-cluster: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00088de80>{
msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-tq9pcx\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"name\": \"09aabd4d-8689-4a5c-8bb1-c3538510c232\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-03T21:26:38.133961239Z\",\n \"endTime\": \"2026-03-03T21:31:47.042145346Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"failed to run transaction handler: Managed clusters on AWS need an account claim before installing\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001289530>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["25"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/canadaeast/3ffbf395-fb71-49fa-8da8-4aab58175900",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["248"],
"X-Ms-Correlation-Request-Id": [
"e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3748"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 7F476DA1539542E4A76F035388135DE5 Ref B: CHI261140509060 Ref C: 2026-03-03T21:31:49Z",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T213149Z:e67e6b76-ed8f-4125-b5c7-121329fd2d3b",
]...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InvalidRequestContent; detail message Duplicate ARO-HCP cluster <cluster>. An ARO-HCP cluster <cluster> name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXX...full failure pattern: ERROR CODE: InvalidRequestContent; detail message Duplicate ARO-HCP cluster <cluster>. An ARO-HCP cluster <cluster> name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure resource group <resource-group> 'patch-name-<id>' already exists; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc00074a1e0>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-dw4sft": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00074a1a0>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011ca330>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ebd6fb37-603d-40fd-a0f5-541cb70c6055",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"Content-Length": ["300"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"9ea6c029-e86c-4435-81b6-ed0298c892ac",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 67BEEBA6A2544538A4518981F15930C8 Ref B: CHI261140512054 Ref C: 2026-03-03T21:30:35Z",
],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 21:30:52 GMT",
],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["17856"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uks...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: Unexpected error:
<*fmt.wrapError | 0xc00074a1e0>:
failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-dw4sft": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-name-cluster: failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00074a1a0>{
msg: "failed starting cluster creation \"patch-name-cluster\" in resourcegroup=\"patch-name-dw4sft\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-dw4sft/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Duplicate ARO-HCP cluster name. An ARO-HCP cluster with name 'patch-name-cluster', Azure Subscription ID 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX', and and Azure Resource group name 'patch-name-dw4sft' already exists\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011ca330>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ebd6fb37-603d-40fd-a0f5-541cb70c6055",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Pragma": ["no-cache"],
"Content-Length": ["300"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"9ea6c029-e86c-4435-81b6-ed0298c892ac",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 67BEEBA6A2544538A4518981F15930C8 Ref B: CHI261140512054 Ref C: 2026-03-03T21:30:35Z",
],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 21:30:52 GMT",
],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["17856"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uks...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create nodepool <nodepool>: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:full failure pattern: failed to create nodepool <nodepool>: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool: Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapError | 0xc0014d2ca0>:
failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:
&armredhatopenshifthcp.NodePool{
Location: &"uksouth",
Identity: nil,
Properties: &armredhatopenshifthcp.NodePoolProperties{
... // 6 identical fields
Taints: nil,
Version: &{ChannelGroup: &"stable", ID: &"4.20.8"},
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: nil,
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc0008972a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
<*fmt.wrapError | 0xc0014d2ca0>:
failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:
&armredhatopenshifthcp.NodePool{
Location: &"uksouth",
Identity: nil,
Properties: &armredhatopenshifthcp.NodePoolProperties{
... // 6 identical fields
Taints: nil,
Version: &{ChannelGroup: &"stable", ID: &"4.20.8"},
- ProvisioningState: &"Succeeded",
+ ProvisioningState: &"Provisioning",
},
Tags: nil,
ID: &"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou"...,
... // 1 ignored and 2 identical fields
}
{
msg: "failed to create NodePool np-1: operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
err: <*errors.errorString | 0xc0008972a0>{
s: "operation result model did not match expected model for type *armredhatopenshifthcp.NodePool:\n &armredhatopenshifthcp.NodePool{\n \tLocation: &\"uksouth\",\n \tIdentity: nil,\n \tProperties: &armredhatopenshifthcp.NodePoolProperties{\n \t\t... // 6 identical fields\n \t\tTaints: nil,\n \t\tVersion: &{ChannelGroup: &\"stable\", ID: &\"4.20.8\"},\n- \t\tProvisioningState: &\"Succeeded\",\n+ \t\tProvisioningState: &\"Provisioning\",\n \t},\n \tTags: nil,\n \tID: &\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGrou\"...,\n \t... // 1 ignored and 2 identical fields\n }\n",
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create route: the server is currently unable to handle the requestfull failure pattern: failed to create route: the server is currently unable to handle the request Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 1 · Mar 7: 0 · Mar 8: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc000b90f40>:
failed to create route: the server is currently unable to handle the request
{
msg: "failed to create route: the server is currently unable to handle the request",
err: <*errors.StatusError | 0xc000cf1900>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "the server is currently unable to handle the request",
Reason: "ServiceUnavailable",
Details: {
Name: "",
Group: "",
Kind: "",
UID: "",
Causes: [
{
Type: "UnexpectedServerResponse",
Message: "error trying to reach service: EOF",
Field: "",
},
],
RetryAfterSeconds: 0,
},
Code: 503,
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
<*fmt.wrapError | 0xc000b90f40>:
failed to create route: the server is currently unable to handle the request
{
msg: "failed to create route: the server is currently unable to handle the request",
err: <*errors.StatusError | 0xc000cf1900>{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "the server is currently unable to handle the request",
Reason: "ServiceUnavailable",
Details: {
Name: "",
Group: "",
Kind: "",
UID: "",
Causes: [
{
Type: "UnexpectedServerResponse",
Message: "error trying to reach service: EOF",
Field: "",
},
],
RetryAfterSeconds: 0,
},
Code: 503,
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
or adjust the parameters in Gomega's 'format' package.full failure pattern: or adjust the parameters in Gomega's 'format' package. Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000a81350>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: NotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NotFound",
"message": "Cluster '2opo4ancuu56jge964b3jdk5rp5s8av4' not found"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "NotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["1482"],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["NotFound"],
"X-Ms-Request-Id": [
"8ac7b452-c6c1-4830-86df-2b2bdbf83106",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T181711Z:8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Msedge-Ref": [
"Ref A: BB9552B9B9FF49CB83494FAF7F2CE729 Ref B: CHI261140505062 Ref C: 2026-03-02T18:17:09Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["126"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Mon, 02 Mar 2026 18:17:11 GMT",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
},
Body: <*exported.nopClosingBytesReader | 0xc001728500>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 108, 117, 115, 116, 101, 114, 32, 39, 50, 111, 112, 111, 52, 97, 110, 99, 117, 117, 53, 54, 106, 103, 101, 57, 54, 52, 98, 51, 106, 100, 107, 53, 114, 112, 53, 115, 56, 97, 118, 52, 39, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 126,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:97]: Expected
<*exported.ResponseError | 0xc000a81350>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: NotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NotFound",
"message": "Cluster '2opo4ancuu56jge964b3jdk5rp5s8av4' not found"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "NotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["1482"],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Error-Code": ["NotFound"],
"X-Ms-Request-Id": [
"8ac7b452-c6c1-4830-86df-2b2bdbf83106",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T181711Z:8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Msedge-Ref": [
"Ref A: BB9552B9B9FF49CB83494FAF7F2CE729 Ref B: CHI261140505062 Ref C: 2026-03-02T18:17:09Z",
],
"Pragma": ["no-cache"],
"Content-Length": ["126"],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Correlation-Request-Id": [
"8e8e6a8c-9217-4058-9bbb-b42ce9f030cd",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Mon, 02 Mar 2026 18:17:11 GMT",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
},
Body: <*exported.nopClosingBytesReader | 0xc001728500>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 108, 117, 115, 116, 101, 114, 32, 39, 50, 111, 112, 111, 52, 97, 110, 99, 117, 117, 53, 54, 106, 103, 101, 57, 54, 52, 98, 51, 106, 100, 107, 53, 114, 112, 53, 115, 56, 97, 118, 52, 39, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 126,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to be nilContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
subscription state not foundfull failure pattern: subscription state not found Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 3.23%1 of 31 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.005s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000970530>:
subscription state not found
{
s: "subscription state not found",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.005s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000970530>:
subscription state not found
{
s: "subscription state not found",
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Environment: STG
E2E Jobs
16
Success Rate
43.75%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.43.75% (7/16)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 56.25% | 16 | stage/parallel | Authorized CIDRs Connectivity should allow API access only from authorized VM IP | |
| 56.25% | 16 | stage/parallel | Customer should be able to create an HCP cluster and manage pull secrets | |
| 56.25% | 16 | stage/parallel | Customer should be able to create node pools with ARM64-based VMs | |
| 62.50% | 16 | stage/parallel | Customer should be able to create a cluster with an external auth config and get the external auth config | |
| 62.50% | 16 | stage/parallel | Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | e2e | 4 | 25.00%4 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 36 · Mar 7: 18 · Mar 8: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014f2ae0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-j85dmd" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<*fmt.wrapErrors | 0xc0014f2ab0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014f2ae0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-j85dmd" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<*fmt.wrapErrors | 0xc0014f2ab0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-j85dmd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000f8f2e0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-j85dmd",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapErrors | 0xc0015f8780>:
failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-48hdws" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<*fmt.wrapErrors | 0xc0015f8750>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapErrors | 0xc0015f8780>:
failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-48hdws" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<*fmt.wrapErrors | 0xc0015f8750>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-48hdws\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0011d1260>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-48hdws",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error:
<*fmt.wrapErrors | 0xc00146b350>:
failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-xfbcmt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded
{
msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<*fmt.wrapErrors | 0xc00146b320>{
msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:89]: Unexpected error:
<*fmt.wrapErrors | 0xc00146b350>:
failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-xfbcmt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded
{
msg: "failed to create HCP cluster negative-tests-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<*fmt.wrapErrors | 0xc00146b320>{
msg: "failed waiting for cluster=\"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-xfbcmt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000847d60>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-xfbcmt",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (18)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 3 | 18.75%3 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 2 · Mar 7: 1 · Mar 8: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.000s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:157]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 3 | 18.75%3 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 2 · Mar 7: 1 · Mar 8: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:35]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:35]: Interrupted by User Contributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create HCP cluster <cluster>: failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url>full failure pattern: failed to create HCP cluster <cluster>: failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url> Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 12.50%2 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 16 · Mar 3: 16 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
<*fmt.wrapError | 0xc00100b6e0>:
failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8zshf2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-cluster: failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00100b6c0>{
msg: "failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015a6c90>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Msedge-Ref": [
"Ref A: 062CB161D1504BBBBC32E414F7FC2EE0 Ref B: CHI261140513023 Ref C: 2026-03-03T02:04:44Z",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/ef1e3554-21f7-413e-9986-3f2b03675fd0",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"X-Ms-Correlation-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc00100b600>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
<*fmt.wrapError | 0xc00100b6e0>:
failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-8zshf2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster basic-cluster: failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc00100b6c0>{
msg: "failed starting cluster creation \"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-8zshf2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-8zshf2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0015a6c90>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Msedge-Ref": [
"Ref A: 062CB161D1504BBBBC32E414F7FC2EE0 Ref B: CHI261140513023 Ref C: 2026-03-03T02:04:44Z",
],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/ef1e3554-21f7-413e-9986-3f2b03675fd0",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"X-Ms-Correlation-Request-Id": [
"b579e2a4-f4ce-4780-91c1-574171c6019a",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc00100b600>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc0009b9060>:
failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation "list-test-cluster-9l52pq" in resourcegroup="cluster-listing-cl569h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009b9040>{
msg: "failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011f5a10>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 4181416C6F604F9FAB3E60A0A746D6B2 Ref B: CHI261140514040 Ref C: 2026-03-03T02:04:45Z",
],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/33f12f27-dfd0-4f86-a6bb-840b8cd332be",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0009b8ee0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc0009b9060>:
failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation "list-test-cluster-9l52pq" in resourcegroup="cluster-listing-cl569h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-9l52pq: failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0009b9040>{
msg: "failed starting cluster creation \"list-test-cluster-9l52pq\" in resourcegroup=\"cluster-listing-cl569h\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cluster-listing-cl569h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/list-test-cluster-9l52pq\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0011f5a10>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
"Date": [
"Tue, 03 Mar 2026 02:04:44 GMT",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 4181416C6F604F9FAB3E60A0A746D6B2 Ref B: CHI261140514040 Ref C: 2026-03-03T02:04:45Z",
],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/33f12f27-dfd0-4f86-a6bb-840b8cd332be",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"2466c3c3-379d-4b31-a164-1d297358d27b",
],
},
Body: <*exported.nopClosingBytesReader | 0xc0009b8ee0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c0a500>:
failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-gmxvqn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000c0a4e0>{
msg: "failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009c97d0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Msedge-Ref": [
"Ref A: DE0330A94FB84A1AA4EA1642CF2BBBF4 Ref B: CH1AA2020620051 Ref C: 2026-03-03T02:04:35Z",
],
"X-Ms-Correlation-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Tue, 03 Mar 2026 02:04:35 GMT",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b311698-8974-40f6-a94b-ce73951280c0",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["6"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020435Z:60d0c633-2099-4096-9ec5-256574c14354",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc000c0a420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c0a500>:
failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-gmxvqn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000c0a4e0>{
msg: "failed starting cluster creation \"node-limit-cluster\" in resourcegroup=\"node-limit-test-gmxvqn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-gmxvqn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0009c97d0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Msedge-Ref": [
"Ref A: DE0330A94FB84A1AA4EA1642CF2BBBF4 Ref B: CH1AA2020620051 Ref C: 2026-03-03T02:04:35Z",
],
"X-Ms-Correlation-Request-Id": [
"60d0c633-2099-4096-9ec5-256574c14354",
],
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Tue, 03 Mar 2026 02:04:35 GMT",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b311698-8974-40f6-a94b-ce73951280c0",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["6"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020435Z:60d0c633-2099-4096-9ec5-256574c14354",
],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc000c0a420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (16)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url>full failure pattern: failed starting cluster creation "<cluster>" in resourcegroup="<resource-group>": PUT <url> Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 12.50%2 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 3 · Mar 3: 3 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: Unexpected error:
<*fmt.wrapError | 0xc000606320>:
failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-6ds7jn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"customer-rg-6ds7jn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f836e0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020515Z:26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["8"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/b6e73d46-c8c1-4ba8-ab8b-f4bde60961dd",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"X-Msedge-Ref": [
"Ref A: 1BBEAFCFBBD842808141C2559244962B Ref B: CH1AA2020603027 Ref C: 2026-03-03T02:05:15Z",
],
"Date": [
"Tue, 03 Mar 2026 02:05:14 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000606240>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5600"],
"Content-Type": ["application/json"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: Unexpected error:
<*fmt.wrapError | 0xc000606320>:
failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-6ds7jn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"basic-hcp-cluster\" in resourcegroup=\"customer-rg-6ds7jn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f836e0>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020515Z:26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Cache-Control": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["8"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/b6e73d46-c8c1-4ba8-ab8b-f4bde60961dd",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Request-Id": [
"26a050f7-afba-4e46-b45e-65cdb9bad078",
],
"X-Msedge-Ref": [
"Ref A: 1BBEAFCFBBD842808141C2559244962B Ref B: CH1AA2020603027 Ref C: 2026-03-03T02:05:15Z",
],
"Date": [
"Tue, 03 Mar 2026 02:05:14 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000606240>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-6ds7jn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5600"],
"Content-Type": ["application/json"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000779b60>:
failed starting cluster creation "admin-cred-lifecycle-kdmgl9" in resourcegroup="admin-credential-lifecycle-test-h54zg6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-kdmgl9\" in resourcegroup=\"admin-credential-lifecycle-test-h54zg6\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00108e930>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["197"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2997"],
"X-Ms-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: E637E21304954189BBCAF67B4EED414D Ref B: CHI261140505062 Ref C: 2026-03-03T02:04:45Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:45 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Correlation-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c3da556d-8c33-46cc-b6a1-3095345a88de",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:ad250214-8157-43ca-8b84-494835990ab3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000779aa0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-ar...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:100]: Unexpected error:
<*fmt.wrapError | 0xc000779b60>:
failed starting cluster creation "admin-cred-lifecycle-kdmgl9" in resourcegroup="admin-credential-lifecycle-test-h54zg6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"admin-cred-lifecycle-kdmgl9\" in resourcegroup=\"admin-credential-lifecycle-test-h54zg6\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00108e930>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["197"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2997"],
"X-Ms-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: E637E21304954189BBCAF67B4EED414D Ref B: CHI261140505062 Ref C: 2026-03-03T02:04:45Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:45 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Correlation-Request-Id": [
"ad250214-8157-43ca-8b84-494835990ab3",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c3da556d-8c33-46cc-b6a1-3095345a88de",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020445Z:ad250214-8157-43ca-8b84-494835990ab3",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000779aa0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-h54zg6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-kdmgl9",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-ar...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
<*fmt.wrapError | 0xc00031a120>:
failed starting cluster creation "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-24xr77": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-24xr77\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00123b500>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Content-Length": ["0"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"Date": [
"Tue, 03 Mar 2026 02:04:32 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c9fe35d6-8282-4a2e-9afa-f6e5aedeb184",
],
"X-Ms-Correlation-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020433Z:cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 01A1E278810D41A394B4755A4302B8F1 Ref B: CHI261140507062 Ref C: 2026-03-03T02:04:32Z",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
},
Body: <*exported.nopClosingBytesReader | 0xc00031a000>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5568"],
"Con...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
<*fmt.wrapError | 0xc00031a120>:
failed starting cluster creation "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-24xr77": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-24xr77\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00123b500>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Content-Length": ["0"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Envoy-Upstream-Service-Time": ["13"],
"X-Ms-Failure-Cause": ["service"],
"Date": [
"Tue, 03 Mar 2026 02:04:32 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c9fe35d6-8282-4a2e-9afa-f6e5aedeb184",
],
"X-Ms-Correlation-Request-Id": [
"cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020433Z:cd9f7d68-5328-4bcf-b26f-0d3774aec105",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 01A1E278810D41A394B4755A4302B8F1 Ref B: CHI261140507062 Ref C: 2026-03-03T02:04:32Z",
],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
},
Body: <*exported.nopClosingBytesReader | 0xc00031a000>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-24xr77/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"Content-Length": ["5568"],
"Con...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (3)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
RESPONSE 502: 502 Bad Gatewayfull failure pattern: RESPONSE 502: 502 Bad Gateway Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 12.50%2 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc000736630>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["21"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Ms-Correlation-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadaeast/ba27f757-9a9b-4484-a280-cd559d08fd5d",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T020343Z:76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Msedge-Ref": [
"Ref A: C43A14F7592A4B0EB9887E19E49E7EC9 Ref B: CH1AA2020620025 Ref C: 2026-03-03T02:03:42Z",
],
"Date": [
"Tue, 03 Mar 2026 02:03:42 GMT",
],
"Expires": ["-1"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc001326a80>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc000736630>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"X-Envoy-Upstream-Service-Time": ["21"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Ms-Correlation-Request-Id": [
"76483cd0-9e72-4868-bc88-2589e1fda479",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadaeast/ba27f757-9a9b-4484-a280-cd559d08fd5d",
],
"X-Ms-Routing-Request-Id": [
"CANADAEAST:20260303T020343Z:76483cd0-9e72-4868-bc88-2589e1fda479",
],
"X-Msedge-Ref": [
"Ref A: C43A14F7592A4B0EB9887E19E49E7EC9 Ref B: CH1AA2020620025 Ref C: 2026-03-03T02:03:42Z",
],
"Date": [
"Tue, 03 Mar 2026 02:03:42 GMT",
],
"Expires": ["-1"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
},
Body: <*exported.nopClosingBytesReader | 0xc001326a80>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Accept": ["application/json"],
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc0008dc570>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T020335Z:51aa9d18-066d-4e9d-868b-fee847027541",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 823A8F27C87B4E83AAB93890B6222AC2 Ref B: CHI261140505042 Ref C: 2026-03-02T02:03:35Z",
],
"Date": [
"Mon, 02 Mar 2026 02:03:35 GMT",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/4c8da580-69cd-47c3-bdbe-fe9e1d9ffb7e",
],
"X-Ms-Correlation-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
},
Body: <*exported.nopClosingBytesReader | 0xc00093f760>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:42]: Unexpected error:
<*exported.ResponseError | 0xc0008dc570>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["7"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260302T020335Z:51aa9d18-066d-4e9d-868b-fee847027541",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 823A8F27C87B4E83AAB93890B6222AC2 Ref B: CHI261140505042 Ref C: 2026-03-02T02:03:35Z",
],
"Date": [
"Mon, 02 Mar 2026 02:03:35 GMT",
],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/4c8da580-69cd-47c3-bdbe-fe9e1d9ffb7e",
],
"X-Ms-Correlation-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Ms-Request-Id": [
"51aa9d18-066d-4e9d-868b-fee847027541",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["0"],
"Pragma": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
},
Body: <*exported.nopClosingBytesReader | 0xc00093f760>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions",
RawPath: "",
OmitHost: false,
ForceQuery: false,
RawQuery: "api-version=2024-06-10-preview",
Fragment: "",
RawFragment: "",
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
],
"Authorization": ["redacted"],
"Accept": ["application/json"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "management.azure.com",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4866,
CurveID: 25,
NegotiatedProtocol: "h2"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Version .* (doesn't exist|is disabled)full failure pattern: Version .* (doesn't exist|is disabled) Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 12.50%2 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000a11da0>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-zg9tr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a11d80>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00133b020>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 99A77695EADC427AA082D3ED564473BF Ref B: CHI261140504025 Ref C: 2026-03-03T02:04:56Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:56 GMT",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/74f411c3-f8b4-468f-98b4-9b6d25fde2f7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020456Z:ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["10"],
},
Body: <*exported.nopClosingBytesReader | 0xc000a11cc0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc00133b0b0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000a11da0>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-zg9tr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000a11d80>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-zg9tr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-zg9tr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00133b020>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 99A77695EADC427AA082D3ED564473BF Ref B: CHI261140504025 Ref C: 2026-03-03T02:04:56Z",
],
"Date": [
"Tue, 03 Mar 2026 02:04:56 GMT",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/74f411c3-f8b4-468f-98b4-9b6d25fde2f7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260303T020456Z:ea937086-84ee-4877-af2a-0e7c65ded5f3",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["10"],
},
Body: <*exported.nopClosingBytesReader | 0xc000a11cc0>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc00133b0b0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000d82500>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-xg8g49": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000d824e0>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001067a40>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/43dc45c5-178f-4ba6-9c89-26234160bbce",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260302T020435Z:e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Msedge-Ref": [
"Ref A: 9400E1E30F6D42FB9824BB4364776479 Ref B: CHI261140508040 Ref C: 2026-03-02T02:04:35Z",
],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"X-Envoy-Upstream-Service-Time": ["9"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 02 Mar 2026 02:04:35 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d82420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc001067ad0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
<*fmt.wrapError | 0xc000d82500>:
failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-xg8g49": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 502: 502 Bad Gateway
ERROR CODE UNAVAILABLE
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000d824e0>{
msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-xg8g49\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-xg8g49/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 502: 502 Bad Gateway\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\nResponse contained no body\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001067a40>{
ErrorCode: "",
StatusCode: 502,
RawResponse: {
Status: "502 Bad Gateway",
StatusCode: 502,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/43dc45c5-178f-4ba6-9c89-26234160bbce",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260302T020435Z:e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"e4087b4e-90a4-483b-bce9-e8de11f4f990",
],
"X-Msedge-Ref": [
"Ref A: 9400E1E30F6D42FB9824BB4364776479 Ref B: CHI261140508040 Ref C: 2026-03-02T02:04:35Z",
],
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Content-Type-Options": ["nosniff"],
"Content-Length": ["0"],
"X-Envoy-Upstream-Service-Time": ["9"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Mon, 02 Mar 2026 02:04:35 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d82420>{s: "", i: 0},
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
to match error
<*matchers.MatchRegexpMatcher | 0xc001067ad0>: {
Regexp: "Version .* (doesn't exist|is disabled)",
Args: nil,
}Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Test Panickedfull failure pattern: Test Panicked Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 6.25%1 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 21 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, INT, PROD | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e89500?, {0x7f128a29bfc0?, 0xc000e68cc0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000e55320, {0x7f128a29bfc0, 0xc000e68cc0}, {0x77d9d2e, 0x7}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func19.2({0x7f128a29bfc0, 0xc000e68cc0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:58 +0x155
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e68cc0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 90
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e89500?, {0x7f128a29bfc0?, 0xc000e68cc0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000e55320, {0x7f128a29bfc0, 0xc000e68cc0}, {0x77d9d2e, 0x7}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func19.2({0x7f128a29bfc0, 0xc000e68cc0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:58 +0x155
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e68cc0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 90
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c1e6c0?, {0x7f1028100d28?, 0xc000e04360?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000826fc0, {0x7f1028100d28, 0xc000e04360}, {0x781d01f, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func18.2({0x7f1028100d28, 0xc000e04360})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:67 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e04360?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 109
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000c1e6c0?, {0x7f1028100d28?, 0xc000e04360?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000826fc0, {0x7f1028100d28, 0xc000e04360}, {0x781d01f, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func18.2({0x7f1028100d28, 0xc000e04360})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:67 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e04360?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 109
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000b0ef40?, {0x7fd9c04c7f98?, 0xc000bea990?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000969c20, {0x7fd9c04c7f98, 0xc000bea990}, {0x77f1edf, 0xc}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func9.2({0x7fd9c04c7f98, 0xc000bea990})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:54 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000bea990?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 94
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000b0ef40?, {0x7fd9c04c7f98?, 0xc000bea990?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000969c20, {0x7fd9c04c7f98, 0xc000bea990}, {0x77f1edf, 0xc}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func9.2({0x7fd9c04c7f98, 0xc000bea990})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:54 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000bea990?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 94
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test PanickedContributing tests (21)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: ServiceUnavailable; detail message Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installa...full failure pattern: ERROR CODE: ServiceUnavailable; detail message Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 6.25%1 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 14 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc000f92120>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-f2swr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f92100>{
msg: "failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e00c30>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Sat, 07 Mar 2026 14:46:39 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["5434"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"X-Msedge-Ref": [
"Ref A: 26E1CBDA73BD43A79BC0F8BDEBA1A221 Ref B: CHI261140511060 Ref C: 2026-03-07T14:46:33Z",
],
"Content-Length": ["257"],
"X-Ms-Failure-Cause": ["service"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"1778cbf7-6dd3-4e0d-8967-ddcd4fa5ce20",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144639Z:7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Operation-Identifier": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc000f92120>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-f2swr2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f92100>{
msg: "failed starting cluster creation \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-f2swr2\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-f2swr2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000e00c30>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Content-Type-Options": ["nosniff"],
"Date": [
"Sat, 07 Mar 2026 14:46:39 GMT",
],
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["5434"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Correlation-Request-Id": [
"7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"X-Msedge-Ref": [
"Ref A: 26E1CBDA73BD43A79BC0F8BDEBA1A221 Ref B: CHI261140511060 Ref C: 2026-03-07T14:46:33Z",
],
"Content-Length": ["257"],
"X-Ms-Failure-Cause": ["service"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Pragma": ["no-cache"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"1778cbf7-6dd3-4e0d-8967-ddcd4fa5ce20",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144639Z:7ee3b7f4-08f3-461c-8ed3-aafb400a1aa6",
],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Operation-Identifier": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapError | 0xc000804440>:
failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-ztzxxw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000804420>{
msg: "failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0010f4180>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Expires": ["-1"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"463c4396-e0a8-4c68-9a68-baa42d6b95ec",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7F2143198592408EBDD587AE8FD44441 Ref B: CHI261140501023 Ref C: 2026-03-07T14:47:35Z",
],
"Date": [
"Sat, 07 Mar 2026 14:47:43 GMT",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Correlation-Request-Id": [
"3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144743Z:3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
"X-Envoy-Upstream-Service-Time": ["8182"],
"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:133]: Unexpected error:
<*fmt.wrapError | 0xc000804440>:
failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-ztzxxw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000804420>{
msg: "failed starting cluster creation \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-ztzxxw\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-ztzxxw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0010f4180>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Expires": ["-1"],
"Retry-After": ["59"],
"X-Ms-Request-Id": [
"463c4396-e0a8-4c68-9a68-baa42d6b95ec",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7F2143198592408EBDD587AE8FD44441 Ref B: CHI261140501023 Ref C: 2026-03-07T14:47:35Z",
],
"Date": [
"Sat, 07 Mar 2026 14:47:43 GMT",
],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Correlation-Request-Id": [
"3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144743Z:3cff8eb7-eb89-4d6a-8163-226407b71770",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
"X-Envoy-Upstream-Service-Time": ["8182"],
"...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc0013e2360>:
failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-dth5xj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-tags-cluster: failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e2340>{
msg: "failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00110a570>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sat, 07 Mar 2026 14:47:09 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/7811f68c-d0c6-4229-bad2-4fa1629e67b7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Request-Id": [
"d8d9e333-730f-490b-9b31-7135ff41c759",
],
"X-Envoy-Upstream-Service-Time": ["2898"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144709Z:a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc0013e2360>:
failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-dth5xj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-tags-cluster: failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0013e2340>{
msg: "failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-dth5xj\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-dth5xj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00110a570>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Sat, 07 Mar 2026 14:47:09 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
"a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/7811f68c-d0c6-4229-bad2-4fa1629e67b7",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Request-Id": [
"d8d9e333-730f-490b-9b31-7135ff41c759",
],
"X-Envoy-Upstream-Service-Time": ["2898"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144709Z:a2a152e9-ec35-406a-9ffc-4ca3a96a79da",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (14)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 6.25%1 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 2 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
<*fmt.wrapError | 0xc001580180>:
failed starting cluster creation "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-88dt2b": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-88dt2b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-88dt2b\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-88dt2b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f927b0>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Correlation-Request-Id": [
"a833f36a-e645-4a5c-8f2c-07a15aea6c19",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: A0279EF3AFD84124B08634E296DEB7D0 Ref B: CHI261140503034 Ref C: 2026-03-07T14:45:09Z",
],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["10012"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144519Z:a833f36a-e645-4a5c-8f2c-07a15aea6c19",
],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Content-Length": ["186"],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Ms-Request-Id": [
"84bcf0ef-9cc3-42c3-b8f3-8fc3210235af",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/3f387671-ff74-44f9-b938-73248e7745e1",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Date": [
"Sat, 07 Mar 2026 14:45:19 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001580040>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
<*fmt.wrapError | 0xc001580180>:
failed starting cluster creation "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-88dt2b": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-88dt2b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed starting cluster creation \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-88dt2b\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-88dt2b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000f927b0>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Correlation-Request-Id": [
"a833f36a-e645-4a5c-8f2c-07a15aea6c19",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: A0279EF3AFD84124B08634E296DEB7D0 Ref B: CHI261140503034 Ref C: 2026-03-07T14:45:09Z",
],
"Content-Type": ["application/json"],
"X-Envoy-Upstream-Service-Time": ["10012"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144519Z:a833f36a-e645-4a5c-8f2c-07a15aea6c19",
],
"X-Content-Type-Options": ["nosniff"],
"Cache-Control": ["no-cache"],
"Content-Length": ["186"],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Ms-Request-Id": [
"84bcf0ef-9cc3-42c3-b8f3-8fc3210235af",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/3f387671-ff74-44f9-b938-73248e7745e1",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Date": [
"Sat, 07 Mar 2026 14:45:19 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc001580040>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0008b0cc0>:
failed to create HCP cluster ea-listkk9gpt: failed starting cluster creation "ea-listkk9gpt" in resourcegroup="ea-list-696m67": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-696m67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listkk9gpt
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-listkk9gpt: failed starting cluster creation \"ea-listkk9gpt\" in resourcegroup=\"ea-list-696m67\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-696m67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listkk9gpt\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008b0ca0>{
msg: "failed starting cluster creation \"ea-listkk9gpt\" in resourcegroup=\"ea-list-696m67\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-696m67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listkk9gpt\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00003bd70>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["186"],
"X-Ms-Request-Id": [
"91c02e2c-cc8d-4422-bd86-5620a3fc1227",
],
"X-Envoy-Upstream-Service-Time": ["10009"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: DADE54595A9D4685B4DD37B0EB4FA0CB Ref B: CHI261140511034 Ref C: 2026-03-07T14:45:09Z",
],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"4bb2aad3-0bc5-4433-ac57-7bf14867b5ad",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Sat, 07 Mar 2026 14:45:19 GMT",
],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/8c204380-4777-4268-9b04-a08592cad436",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144519Z:4bb2aad3-0bc5-4433-ac57-7bf148...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
<*fmt.wrapError | 0xc0008b0cc0>:
failed to create HCP cluster ea-listkk9gpt: failed starting cluster creation "ea-listkk9gpt" in resourcegroup="ea-list-696m67": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-696m67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listkk9gpt
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: LockContention
--------------------------------------------------------------------------------
{
"error": {
"code": "LockContention",
"message": "Failed to acquire lock: timed out",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ea-listkk9gpt: failed starting cluster creation \"ea-listkk9gpt\" in resourcegroup=\"ea-list-696m67\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-696m67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listkk9gpt\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008b0ca0>{
msg: "failed starting cluster creation \"ea-listkk9gpt\" in resourcegroup=\"ea-list-696m67\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-696m67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listkk9gpt\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00003bd70>{
ErrorCode: "LockContention",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["186"],
"X-Ms-Request-Id": [
"91c02e2c-cc8d-4422-bd86-5620a3fc1227",
],
"X-Envoy-Upstream-Service-Time": ["10009"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: DADE54595A9D4685B4DD37B0EB4FA0CB Ref B: CHI261140511034 Ref C: 2026-03-07T14:45:09Z",
],
"Expires": ["-1"],
"Retry-After": ["10"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Correlation-Request-Id": [
"4bb2aad3-0bc5-4433-ac57-7bf14867b5ad",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Sat, 07 Mar 2026 14:45:19 GMT",
],
"X-Ms-Error-Code": ["LockContention"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/8c204380-4777-4268-9b04-a08592cad436",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260307T144519Z:4bb2aad3-0bc5-4433-ac57-7bf148...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Should receive valid HTTP status code from authorized IPfull failure pattern: Should receive valid HTTP status code from authorized IP Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 6.25%1 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:168]: Timed out after 120.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:167 with:
Should receive valid HTTP status code from authorized IP
Expected
<string>: 000
to match regular expression
<string>: ^[2-5][0-9][0-9]$Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
subscription state not foundfull failure pattern: subscription state not found Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 6.25%1 of 16 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 1 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.000s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000482ec0>:
subscription state not found
{
s: "subscription state not found",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.000s.
NFD operator should be installed successfully
Expected success, but got an error:
<*errors.errorString | 0xc000482ec0>:
subscription state not found
{
s: "subscription state not found",
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Environment: PROD
E2E Jobs
24
Success Rate
45.83%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.45.83% (11/24)
Daily Run Outcomes
Successful runs
Provision failures
E2E failures
Other failures
| Pass rate | Runs | Date (UTC) | Suite | Test |
|---|---|---|---|---|
| 66.67% | 24 | prod/parallel | Authorized CIDRs Connectivity should allow API access only from authorized VM IP | |
| 66.67% | 24 | prod/parallel | Customer should be able to create a cluster with an external auth config and get the external auth config | |
| 66.67% | 24 | prod/parallel | Customer should be able to create an HCP cluster and custom node pool osDisk size | |
| 66.67% | 24 | prod/parallel | Customer should be able to create an HCP cluster and manage pull secrets | |
| 66.67% | 24 | prod/parallel | Customer should create an HCP cluster and validate TLS certificates |
Up to 50 failure patterns are loaded (minimum 1.00% impact), with 10 shown by default. Click column headers to re-sort.
Jump to the full Failure Patterns view for this window
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Deserializaion Error: no output from commandfull failure pattern: Deserializaion Error: no output from command Signal: NoiseSignal: Noise — source deserialization/no-output error | e2e | 7 | 29.17%7 of 24 job runs affected | NoiseSignal: Noise — source deserialization/no-output error | Show trend detailsMar 1: 2 · Mar 2: 1 · Mar 3: 5 · Mar 4: 1 · Mar 5: 2 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)o complete creation")
> _, err = poller2.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000d270b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 48
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:135 @ 03/05/26 07:05:43.617
"ts"="2026-03-05 07:05:43.617714" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 07:05:43.617781" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-kwnth4" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:43.829234" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-kwnth4" "resourceGroup"=""
"ts"="2026-03-05 07:05:45.615032" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-4clpsq" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:45.785098" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-4clpsq" "resourceGroup"=""
"ts"="2026-03-05 07:05:47.508736" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508844" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508918" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 07:05:47.509851" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-108"
"ts"="2026-03-05 07:05:47.509863" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-124"
"ts"="2026-03-05 07:05:47.509936" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:47.509891" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-120"
"ts"="2026-03-05 07:05:47.705727" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-05 07:05:47.837833" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster2-4clpsq"
"ts"="2026-03-05 07:05:47.842262" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.843623" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.971538" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="msi-deployment-120"
"ts"="2026-03-05 07:05:47.971609" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="msi-deployment-124"
"ts"="2026-03-05 07:05:47.979881" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.993788" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-05 07:05:48.130080" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster-kwnth4"
"ts"="2026-03-05 07:05:48.635410" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="msi-deployment-108"
"ts"="2026-03-05 07:05:48.772313" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 07:05:48.772502" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 07:05:48.772619" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392780" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392812" "level"=0 "msg"="deleting resource group" "resourceGroup"="customer-rg-hxctbd"
Command Error: signal: killed
Deserializaion Error: no output from command
o complete creation")
> _, err = poller2.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
| Frequency: framework.StandardPollInterval,
| })
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000d270b0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 48
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
------------------------------
[FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:135 @ 03/05/26 07:05:43.617
"ts"="2026-03-05 07:05:43.617714" "level"=0 "msg"="Commiting timing metadata."
"ts"="2026-03-05 07:05:43.617781" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-kwnth4" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:43.829234" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-kwnth4" "resourceGroup"=""
"ts"="2026-03-05 07:05:45.615032" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-4clpsq" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:45.785098" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-4clpsq" "resourceGroup"=""
"ts"="2026-03-05 07:05:47.508736" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508844" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
"ts"="2026-03-05 07:05:47.508918" "level"=0 "msg"="collecting debug info"
"ts"="2026-03-05 07:05:47.509851" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-108"
"ts"="2026-03-05 07:05:47.509863" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-124"
"ts"="2026-03-05 07:05:47.509936" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:05:47.509891" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-120"
"ts"="2026-03-05 07:05:47.705727" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
"ts"="2026-03-05 07:05:47.837833" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster2-4clpsq"
"ts"="2026-03-05 07:05:47.842262" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.843623" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.971538" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-120" "deployment"="msi-deployment-120"
"ts"="2026-03-05 07:05:47.971609" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-124" "deployment"="msi-deployment-124"
"ts"="2026-03-05 07:05:47.979881" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="pooledMsiScopedAssignments"
"ts"="2026-03-05 07:05:47.993788" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
"ts"="2026-03-05 07:05:48.130080" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-hxctbd" "deployment"="customer-infra-basic-hcp-cluster-kwnth4"
"ts"="2026-03-05 07:05:48.635410" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-108" "deployment"="msi-deployment-108"
"ts"="2026-03-05 07:05:48.772313" "level"=0 "msg"="finished collecting debug info"
"ts"="2026-03-05 07:05:48.772502" "level"=0 "msg"="deleting created resources"
"ts"="2026-03-05 07:05:48.772619" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392780" "level"=0 "msg"="no left behind managed resource groups found" "resourceGroup"="customer-rg-hxctbd"
"ts"="2026-03-05 07:20:34.392812" "level"=0 "msg"="deleting resource group" "resourceGroup"="customer-rg-hxctbd"
Command Error: signal: killed
Deserializaion Error: no output from command.(*clientConnReadLoop).run(0xc000383fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000383f60 sp=0xc000383e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001550380)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000383fc8 sp=0xc000383f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000383fe0 sp=0xc000383fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000383fe8 sp=0xc000383fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 95
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
goroutine 1155 gp=0xc001550a80 m=nil [IO wait]:
runtime.gopark(0xc0008a3600?, 0xc000e11758?, 0x6c?, 0xa0?, 0xb?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000e11720 sp=0xc000e11700 pc=0x2abd28e
runtime.netpollblock(0x2b26d58?, 0x2a49046?, 0x0?)
/usr/local/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000e11758 sp=0xc000e11720 pc=0x2a7ce97
internal/poll.runtime_pollWait(0x7f281ec6ca00, 0x72)
/usr/local/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000e11778 sp=0xc000e11758 pc=0x2abbb25
internal/poll.(*pollDesc).wait(0xc000251d80?, 0xc00148c000?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000e117a0 sp=0xc000e11778 pc=0x2b49a87
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000251d80, {0xc00148c000, 0x1300, 0x1300})
/usr/local/go/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc000e11838 sp=0xc000e117a0 pc=0x2b4aeb9
net.(*netFD).Read(0xc000251d80, {0xc00148c000?, 0xc00148c000?, 0x5?})
/usr/local/go/src/net/fd_posix.go:68 +0x25 fp=0xc000e11880 sp=0xc000e11838 pc=0x2cdf185
net.(*conn).Read(0xc0009360c8, {0xc00148c000?, 0x7f286585c210?, 0x7f28658535c0?})
/usr/local/go/src/net/net.go:196 +0x45 fp=0xc000e118c8 sp=0xc000e11880 pc=0x2cf1225
crypto/tls.(*atLeastReader).Read(0xc000013b60, {0xc00148c000?, 0x12fb?, 0xe?})
/usr/local/go/src/crypto/tls/conn.go:819 +0x3b fp=0xc000e11910 sp=0xc000e118c8 pc=0x2d5cadb
bytes.(*Buffer).ReadFrom(0xc00095d428, {0x8173120, 0xc000013b60})
/usr/local/go/src/bytes/buffer.go:217 +0x98 fp=0xc000e11968 sp=0xc000e11910 pc=0x2b87a38
crypto/tls.(*Conn).readFromUntil(0xc00095d188, {0x8173b20, 0xc0009360c8}, 0xc000e119d0?)
/usr/local/go/src/crypto/tls/conn.go:841 +0xde fp=0xc000e119a0 sp=0xc000e11968 pc=0x2d5ccbe
crypto/tls.(*Conn).readRecordOrCCS(0xc00095d188, 0x0)
/usr/local/go/src/crypto/tls/conn.go:630 +0x3db fp=0xc000e11c18 sp=0xc000e119a0 pc=0x2d59d3b
crypto/tls.(*Conn).readRecord(...)
/usr/local/go/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc00095d188, {0xc001478000, 0x1000, 0x319b220?})
/usr/local/go/src/crypto/tls/conn.go:1397 +0x145 fp=0xc000e11c80 sp=0xc000e11c18 pc=0x2d60625
bufio.(*Reader).Read(0xc000e81440, {0xc00154e2e4, 0x9, 0x2a409ab?})
/usr/local/go/src/bufio/bufio.go:245 +0x197 fp=0xc000e11cb8 sp=0xc000e11c80 pc=0x2c22617
io.ReadAtLeast({0x8172700, 0xc000e81440}, {0xc00154e2e4, 0x9, 0x9}, 0x9)
/usr/local/go/src/io/io.go:335 +0x8e fp=0xc000e11d00 sp=0xc000e11cb8 pc=0x2b17aee
io.ReadFull(...)
/usr/local/go/src/io/io.go:354
golang.org/x/net/http2.readFrameHeader({0xc00154e2e4, 0x9, 0x6cd24e0?}, {0x8172700?, 0xc000e81440?})
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:242 +0x65 fp=0xc000e11d50 sp=0xc000e11d00 pc=0x31929c5
golang.org/x/net/http2.(*Framer).ReadFrameHeader(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:505 +0x6b fp=0xc000e11dd8 sp=0xc000e11d50 pc=0x319358b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:564 +0x18 fp=0xc000e11e18 sp=0xc000e11dd8 pc=0x3193cf8
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc000e11fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000e11f60 sp=0xc000e11e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001551c00)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000e11fc8 sp=0xc000e11f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000e11fe0 sp=0xc000e11fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e11fe8 sp=0xc000e11fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 1154
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
rax 0xfffffffffffffffc
rbx 0x5
rcx 0x2a3ce0e
rdx 0x80
rdi 0x5
rsi 0x7ffff925c09c
rbp 0x7ffff925c050
rsp 0x7ffff925c008
r8 0x0
r9 0x0
r10 0x11ba
r11 0x246
r12 0x7ffff925c0e0
r13 0x1
r14 0xb2ed360
r15 0x5
rip 0x2a3ce0e
rflags 0x246
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from command
.(*clientConnReadLoop).run(0xc000383fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000383f60 sp=0xc000383e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001550380)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000383fc8 sp=0xc000383f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000383fe0 sp=0xc000383fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000383fe8 sp=0xc000383fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 95
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
goroutine 1155 gp=0xc001550a80 m=nil [IO wait]:
runtime.gopark(0xc0008a3600?, 0xc000e11758?, 0x6c?, 0xa0?, 0xb?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000e11720 sp=0xc000e11700 pc=0x2abd28e
runtime.netpollblock(0x2b26d58?, 0x2a49046?, 0x0?)
/usr/local/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000e11758 sp=0xc000e11720 pc=0x2a7ce97
internal/poll.runtime_pollWait(0x7f281ec6ca00, 0x72)
/usr/local/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000e11778 sp=0xc000e11758 pc=0x2abbb25
internal/poll.(*pollDesc).wait(0xc000251d80?, 0xc00148c000?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000e117a0 sp=0xc000e11778 pc=0x2b49a87
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000251d80, {0xc00148c000, 0x1300, 0x1300})
/usr/local/go/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc000e11838 sp=0xc000e117a0 pc=0x2b4aeb9
net.(*netFD).Read(0xc000251d80, {0xc00148c000?, 0xc00148c000?, 0x5?})
/usr/local/go/src/net/fd_posix.go:68 +0x25 fp=0xc000e11880 sp=0xc000e11838 pc=0x2cdf185
net.(*conn).Read(0xc0009360c8, {0xc00148c000?, 0x7f286585c210?, 0x7f28658535c0?})
/usr/local/go/src/net/net.go:196 +0x45 fp=0xc000e118c8 sp=0xc000e11880 pc=0x2cf1225
crypto/tls.(*atLeastReader).Read(0xc000013b60, {0xc00148c000?, 0x12fb?, 0xe?})
/usr/local/go/src/crypto/tls/conn.go:819 +0x3b fp=0xc000e11910 sp=0xc000e118c8 pc=0x2d5cadb
bytes.(*Buffer).ReadFrom(0xc00095d428, {0x8173120, 0xc000013b60})
/usr/local/go/src/bytes/buffer.go:217 +0x98 fp=0xc000e11968 sp=0xc000e11910 pc=0x2b87a38
crypto/tls.(*Conn).readFromUntil(0xc00095d188, {0x8173b20, 0xc0009360c8}, 0xc000e119d0?)
/usr/local/go/src/crypto/tls/conn.go:841 +0xde fp=0xc000e119a0 sp=0xc000e11968 pc=0x2d5ccbe
crypto/tls.(*Conn).readRecordOrCCS(0xc00095d188, 0x0)
/usr/local/go/src/crypto/tls/conn.go:630 +0x3db fp=0xc000e11c18 sp=0xc000e119a0 pc=0x2d59d3b
crypto/tls.(*Conn).readRecord(...)
/usr/local/go/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc00095d188, {0xc001478000, 0x1000, 0x319b220?})
/usr/local/go/src/crypto/tls/conn.go:1397 +0x145 fp=0xc000e11c80 sp=0xc000e11c18 pc=0x2d60625
bufio.(*Reader).Read(0xc000e81440, {0xc00154e2e4, 0x9, 0x2a409ab?})
/usr/local/go/src/bufio/bufio.go:245 +0x197 fp=0xc000e11cb8 sp=0xc000e11c80 pc=0x2c22617
io.ReadAtLeast({0x8172700, 0xc000e81440}, {0xc00154e2e4, 0x9, 0x9}, 0x9)
/usr/local/go/src/io/io.go:335 +0x8e fp=0xc000e11d00 sp=0xc000e11cb8 pc=0x2b17aee
io.ReadFull(...)
/usr/local/go/src/io/io.go:354
golang.org/x/net/http2.readFrameHeader({0xc00154e2e4, 0x9, 0x6cd24e0?}, {0x8172700?, 0xc000e81440?})
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:242 +0x65 fp=0xc000e11d50 sp=0xc000e11d00 pc=0x31929c5
golang.org/x/net/http2.(*Framer).ReadFrameHeader(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:505 +0x6b fp=0xc000e11dd8 sp=0xc000e11d50 pc=0x319358b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc00154e2a0)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/frame.go:564 +0x18 fp=0xc000e11e18 sp=0xc000e11dd8 pc=0x3193cf8
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc000e11fa8)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2258 +0xca fp=0xc000e11f60 sp=0xc000e11e18 pc=0x31a62aa
golang.org/x/net/http2.(*ClientConn).readLoop(0xc001551c00)
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:2127 +0x52 fp=0xc000e11fc8 sp=0xc000e11f60 pc=0x31a5632
golang.org/x/net/http2.(*Transport).newClientConn.gowrap1()
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0x25 fp=0xc000e11fe0 sp=0xc000e11fc8 pc=0x319edc5
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e11fe8 sp=0xc000e11fe0 pc=0x2ac5921
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 1154
/go/pkg/mod/golang.org/x/net@v0.49.0/http2/transport.go:880 +0xda5
rax 0xfffffffffffffffc
rbx 0x5
rcx 0x2a3ce0e
rdx 0x80
rdi 0x5
rsi 0x7ffff925c09c
rbp 0x7ffff925c050
rsp 0x7ffff925c008
r8 0x0
r9 0x0
r10 0x11ba
r11 0x246
r12 0x7ffff925c0e0
r13 0x1
r14 0xb2ed360
r15 0x5
rip 0x2a3ce0e
rflags 0x246
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from commandp=0xc000cf3900 sp=0xc000cf38e0 pc=0x2abd28e
runtime.selectgo(0xc000cf49a0, 0xc000cf3cf4, 0x0?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000cf3a40 sp=0xc000cf3900 pc=0x2a98137
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode(_, {0x42, 0x4, {0x78ef949, 0x41}, 0xc000d855e0, {{0x968cd56, 0x4b}, 0x7a, {0x0, ...}, ...}, ...}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:923 +0xf65 fp=0xc000cf4d38 sp=0xc000cf3a40 pc=0x2f00005
github.com/onsi/ginkgo/v2/internal.(*group).attemptSpec(0xc000cf6b98, 0x1, {{0xc000a9ea88?, 0xc000598bc0?, 0x1?}, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:199 +0xbd3 fp=0xc000cf5d58 sp=0xc000cf4d38 pc=0x2ee5453
github.com/onsi/ginkgo/v2/internal.(*group).run(0xc000cf6b98, {0xc000159100?, 0x0?, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:349 +0x905 fp=0xc000cf6960 sp=0xc000cf5d58 pc=0x2ee79e5
github.com/onsi/ginkgo/v2/internal.(*Suite).runSpecs(0xc00085d508, {0x0, 0x0}, {0xb319ac0, 0x0, 0x0}, {0xc00007a064, 0x2a}, 0x0, {0xc0001590e0, ...})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496 +0xa9b fp=0xc000cf6e10 sp=0xc000cf6960 pc=0x2efb4db
github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a064, 0x2a}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68 +0x3c5 fp=0xc000cf6eb8 sp=0xc000cf6e10 pc=0x2f02845
github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2a4ca65?, 0xc000302300?})
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/ginkgo/util.go:85 +0x2ba fp=0xc000cf7b88 sp=0xc000cf6eb8 pc=0x521c71a
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x820bbb8, 0xc000b9f0e0}, 0xc000861680, 0x1)
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:596 +0xee fp=0xc000cf7c30 sp=0xc000cf7b88 pc=0x5212a8e
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:237 +0x196 fp=0xc000cf7fe0 sp=0xc000cf7c30 pc=0x520e816
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000cf7fe8 sp=0xc000cf7fe0 pc=0x2ac5921
created by github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:230 +0x1e5
goroutine 86 gp=0xc000b32e00 m=nil [select, 2 minutes]:
runtime.gopark(0xc000b3d868?, 0x2?, 0xc8?, 0x2d?, 0xc000b3d834?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000b3d6b8 sp=0xc000b3d698 pc=0x2abd28e
runtime.selectgo(0xc000b3d868, 0xc000b3d830, 0x816e580?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000b3d7f8 sp=0xc000b3d6b8 pc=0x2a98137
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).AssignIdentityContainers(0xc0008ae120, {0x7f0b68c01c60, 0xc000811dd0}, 0x1, 0xdf8475800)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/identities_helper.go:271 +0x218 fp=0xc000b3d8e0 sp=0xc000b3d7f8 pc=0x4e997f8
github.com/Azure/ARO-HCP/test/e2e.init.func23.3({0x7f0b68c01c60, 0xc000811dd0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:135 +0x6a fp=0xc000b3df58 sp=0xc000b3d8e0 pc=0x501aaea
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000811dd0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e fp=0xc000b3df88 sp=0xc000b3df58 pc=0x2eed25e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc000b3dfe0 sp=0xc000b3df88 pc=0x2f0197b
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b3dfe8 sp=0xc000b3dfe0 pc=0x2ac5921
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 83
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
rax 0xca
rbx 0x0
rcx 0x2ac7743
rdx 0x0
rdi 0xb2ef450
rsi 0x80
rbp 0x7fff3f6424d0
rsp 0x7fff3f642488
r8 0x0
r9 0x0
r10 0x0
r11 0x286
r12 0x2
r13 0x1
r14 0xb2ed360
r15 0x7
rip 0x2ac7741
rflags 0x286
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from command
p=0xc000cf3900 sp=0xc000cf38e0 pc=0x2abd28e
runtime.selectgo(0xc000cf49a0, 0xc000cf3cf4, 0x0?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000cf3a40 sp=0xc000cf3900 pc=0x2a98137
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode(_, {0x42, 0x4, {0x78ef949, 0x41}, 0xc000d855e0, {{0x968cd56, 0x4b}, 0x7a, {0x0, ...}, ...}, ...}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:923 +0xf65 fp=0xc000cf4d38 sp=0xc000cf3a40 pc=0x2f00005
github.com/onsi/ginkgo/v2/internal.(*group).attemptSpec(0xc000cf6b98, 0x1, {{0xc000a9ea88?, 0xc000598bc0?, 0x1?}, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:199 +0xbd3 fp=0xc000cf5d58 sp=0xc000cf4d38 pc=0x2ee5453
github.com/onsi/ginkgo/v2/internal.(*group).run(0xc000cf6b98, {0xc000159100?, 0x0?, 0x0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/group.go:349 +0x905 fp=0xc000cf6960 sp=0xc000cf5d58 pc=0x2ee79e5
github.com/onsi/ginkgo/v2/internal.(*Suite).runSpecs(0xc00085d508, {0x0, 0x0}, {0xb319ac0, 0x0, 0x0}, {0xc00007a064, 0x2a}, 0x0, {0xc0001590e0, ...})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:496 +0xa9b fp=0xc000cf6e10 sp=0xc000cf6960 pc=0x2efb4db
github.com/onsi/ginkgo/v2/internal.(*Suite).RunSpec(_, {_, _}, {_, _, _}, {_, _}, {0xc00007a064, 0x2a}, ...)
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite_patch.go:68 +0x3c5 fp=0xc000cf6eb8 sp=0xc000cf6e10 pc=0x2f02845
github.com/openshift-eng/openshift-tests-extension/pkg/ginkgo.BuildExtensionTestSpecsFromOpenShiftGinkgoSuite.func1.1({0x2a4ca65?, 0xc000302300?})
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/ginkgo/util.go:85 +0x2ba fp=0xc000cf7b88 sp=0xc000cf6eb8 pc=0x521c71a
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.runSpec({0x820bbb8, 0xc000b9f0e0}, 0xc000861680, 0x1)
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:596 +0xee fp=0xc000cf7c30 sp=0xc000cf7b88 pc=0x5212a8e
github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run.func2()
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:237 +0x196 fp=0xc000cf7fe0 sp=0xc000cf7c30 pc=0x520e816
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000cf7fe8 sp=0xc000cf7fe0 pc=0x2ac5921
created by github.com/openshift-eng/openshift-tests-extension/pkg/extension/extensiontests.ExtensionTestSpecs.Run in goroutine 1
/go/pkg/mod/github.com/openshift-eng/openshift-tests-extension@v0.0.0-20260127124016-0fed2b824818/pkg/extension/extensiontests/spec.go:230 +0x1e5
goroutine 86 gp=0xc000b32e00 m=nil [select, 2 minutes]:
runtime.gopark(0xc000b3d868?, 0x2?, 0xc8?, 0x2d?, 0xc000b3d834?)
/usr/local/go/src/runtime/proc.go:460 +0xce fp=0xc000b3d6b8 sp=0xc000b3d698 pc=0x2abd28e
runtime.selectgo(0xc000b3d868, 0xc000b3d830, 0x816e580?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:351 +0x8b7 fp=0xc000b3d7f8 sp=0xc000b3d6b8 pc=0x2a98137
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).AssignIdentityContainers(0xc0008ae120, {0x7f0b68c01c60, 0xc000811dd0}, 0x1, 0xdf8475800)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/identities_helper.go:271 +0x218 fp=0xc000b3d8e0 sp=0xc000b3d7f8 pc=0x4e997f8
github.com/Azure/ARO-HCP/test/e2e.init.func23.3({0x7f0b68c01c60, 0xc000811dd0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:135 +0x6a fp=0xc000b3df58 sp=0xc000b3d8e0 pc=0x501aaea
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000811dd0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e fp=0xc000b3df88 sp=0xc000b3df58 pc=0x2eed25e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc000b3dfe0 sp=0xc000b3df88 pc=0x2f0197b
runtime.goexit({})
/usr/local/go/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b3dfe8 sp=0xc000b3dfe0 pc=0x2ac5921
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 83
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
rax 0xca
rbx 0x0
rcx 0x2ac7743
rdx 0x0
rdi 0xb2ef450
rsi 0x80
rbp 0x7fff3f6424d0
rsp 0x7fff3f642488
r8 0x0
r9 0x0
r10 0x0
r11 0x286
r12 0x2
r13 0x1
r14 0xb2ed360
r15 0x7
rip 0x2ac7741
rflags 0x286
cs 0x33
fs 0x0
gs 0x0
Command Error: exit status 2
Deserializaion Error: no output from commandContributing tests (4)
Affected runs (7)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interrupted by Userfull failure pattern: Interrupted by User Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 7 | 29.17%7 of 24 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 12 · Mar 4: 16 · Mar 5: 2 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [:0]: Interrupted by User fail [:0]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:48]: Interrupted by User fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:48]: Interrupted by User Contributing tests (17)
Affected runs (7)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during CreateHCPClusterAndWait; context deadline exceededfull failure pattern: timeout during CreateHCPClusterAndWait; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | e2e | 6 | 25.00%6 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 3 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 21 · Mar 4: 0 · Mar 5: 5 · Mar 6: 0 · Mar 7: 2 · Mar 8: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapErrors | 0xc001512510>:
failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-7p9vzj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded
{
msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<*fmt.wrapErrors | 0xc0015124e0>{
msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapErrors | 0xc001512510>:
failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-7p9vzj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded
{
msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<*fmt.wrapErrors | 0xc0015124e0>{
msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-7p9vzj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ec57c0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-7p9vzj",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014942d0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-pf6t7j" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<*fmt.wrapErrors | 0xc0014942a0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
<*fmt.wrapErrors | 0xc0014942d0>:
failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-pf6t7j" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded
{
msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<*fmt.wrapErrors | 0xc0014942a0>{
msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-pf6t7j\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000e2e560>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-pf6t7j",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc000e4e540>:
failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster="list-test-cluster-jfhd8m" in resourcegroup="cluster-listing-dtc5mn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<*fmt.wrapErrors | 0xc000e4e510>{
msg: "failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<context.deadlineExceededError>{},
],
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapErrors | 0xc000e4e540>:
failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster="list-test-cluster-jfhd8m" in resourcegroup="cluster-listing-dtc5mn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded
{
msg: "failed to create HCP cluster list-test-cluster-jfhd8m, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<*fmt.wrapErrors | 0xc000e4e510>{
msg: "failed waiting for cluster=\"list-test-cluster-jfhd8m\" in resourcegroup=\"cluster-listing-dtc5mn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000ea4ad0>{
s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-jfhd8m in resource group cluster-listing-dtc5mn",
},
<context.deadlineExceededError>{},
],
},
],
}
occurredContributing tests (15)
Affected runs (6)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 4 | 16.67%4 of 24 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 1: 0 · Mar 2: 8 · Mar 3: 4 · Mar 4: 5 · Mar 5: 7 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, INT | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc0014cc990>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-mbd9lr" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001298900>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr",
},
<*fmt.wrapError | 0xc000dce820>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
<*fmt.wrapErrors | 0xc0014cc990>:
failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-mbd9lr" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc001298900>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-mbd9lr",
},
<*fmt.wrapError | 0xc000dce820>{
msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-mbd9lr\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000ef68d0>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool="np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-sgkhjw" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0004deee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw",
},
<*fmt.wrapError | 0xc000517520>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000ef68d0>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool="np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-sgkhjw" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw, error: failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0004deee0>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group basic-cluster-sgkhjw",
},
<*fmt.wrapError | 0xc000517520>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-sgkhjw\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: Unexpected error:
<*fmt.wrapErrors | 0xc00137f290>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-hlwxtl" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00068dd20>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl",
},
<*fmt.wrapError | 0xc000d26be0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: Unexpected error:
<*fmt.wrapErrors | 0xc00137f290>:
failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-hlwxtl" to finish creating: context deadline exceeded
{
msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00068dd20>{
s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-hlwxtl",
},
<*fmt.wrapError | 0xc000d26be0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-hlwxtl\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
],
}
occurredContributing tests (9)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CreateOrUpdateExternalAuthAndWait timed out after <minutes> minutes; context deadline exceededfull failure pattern: CreateOrUpdateExternalAuthAndWait timed out after <minutes> minutes; context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 4 | 16.67%4 of 24 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 1 · Mar 4: 1 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000877800>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-dzsdxm" for cluster="ea-listxfk7fg" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-dzsdxm\" for cluster=\"ea-listxfk7fg\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0008746a0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000877800>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-dzsdxm" for cluster="ea-listxfk7fg" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-dzsdxm\" for cluster=\"ea-listxfk7fg\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0008746a0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listxfk7fg in resource group ea-list-dzsdxm",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc001057380>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-8crjbf" for cluster="ea-listr26d5r" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-8crjbf\" for cluster=\"ea-listr26d5r\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000717760>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc001057380>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-8crjbf" for cluster="ea-listr26d5r" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-8crjbf\" for cluster=\"ea-listr26d5r\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000717760>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listr26d5r in resource group ea-list-8crjbf",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000eccd20>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-ls8jkz" for cluster="ea-listdwzhrk" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-ls8jkz\" for cluster=\"ea-listdwzhrk\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00083abf0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
<*fmt.wrapErrors | 0xc000eccd20>:
failed waiting for external auth "ea-list" in resourcegroup="ea-list-ls8jkz" for cluster="ea-listdwzhrk" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded
{
msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-ls8jkz\" for cluster=\"ea-listdwzhrk\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc00083abf0>{
s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-listdwzhrk in resource group ea-list-ls8jkz",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cluster should become ready within 45 minutesfull failure pattern: Cluster should become ready within 45 minutes Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 3 | 12.50%3 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 2 · Mar 4: 0 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.004s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.145s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.145s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be truefail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.006s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.006s.
Cluster should become ready within 45 minutes
Expected
<bool>: false
to be trueContributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Test Panickedfull failure pattern: Test Panicked Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 2 | 8.33%2 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 25 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV, INT, STG | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e90140?, {0x7ff6a549ca60?, 0xc000b0d170?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000dc4a20, {0x7ff6a549ca60, 0xc000b0d170}, {0x781cf8c, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func5.1.1({0x7ff6a549ca60, 0xc000b0d170})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:68 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000b0d170?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 85
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000e90140?, {0x7ff6a549ca60?, 0xc000b0d170?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc000dc4a20, {0x7ff6a549ca60, 0xc000b0d170}, {0x781cf8c, 0x15}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func5.1.1({0x7ff6a549ca60, 0xc000b0d170})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:68 +0xe9
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000b0d170?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 85
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000aca550?, {0x7f5094d33060?, 0xc000e80c90?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0008ab0e0, {0x7f5094d33060, 0xc000e80c90}, {0x784e4b5, 0x1f}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func3.1({0x7f5094d33060, 0xc000e80c90})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:66 +0x13f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e80c90?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 62
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).GetARMResourcesClientFactoryOrDie(0xc000aca550?, {0x7f5094d33060?, 0xc000e80c90?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:603 +0x37
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).NewResourceGroup(0xc0008ab0e0, {0x7f5094d33060, 0xc000e80c90}, {0x784e4b5, 0x1f}, {0xc0000140b9, 0x7})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:367 +0x2a5
github.com/Azure/ARO-HCP/test/e2e.init.func3.1({0x7f5094d33060, 0xc000e80c90})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:66 +0x13f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000e80c90?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 62
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panickedgithub.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).Get20240610ClientFactoryOrDie(0x78497cf?, {0x7f81f89bf020?, 0xc000ea21e0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:611 +0x37
github.com/Azure/ARO-HCP/test/e2e.init.func1.1({0x7f81f89bf020, 0xc000ea21e0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:38 +0x6f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ea21e0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 88
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked
github.com/Azure/ARO-HCP/test/util/framework.Must[...](...)
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).Get20240610ClientFactoryOrDie(0x78497cf?, {0x7f81f89bf020?, 0xc000ea21e0?})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:611 +0x37
github.com/Azure/ARO-HCP/test/e2e.init.func1.1({0x7f81f89bf020, 0xc000ea21e0})
/opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:38 +0x6f
github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8221420?, 0xc000ea21e0?})
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465 +0x3e
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 88
/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test Panicked: failed building environment credential: AZURE_TOKEN_CREDENTIALS must be set when RequireAzureTokenCredentials is true. See https://aka.ms/azsdk/go/identity/docs#DefaultAzureCredential for more information
fail [github.com/Azure/ARO-HCP/test/util/framework/per_invocation_framework.go:402]: Test PanickedContributing tests (17)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster credsfull failure pattern: timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 8.33%2 of 24 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 6 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
<*fmt.wrapErrors | 0xc0007de9f0>:
failed waiting for hcpCluster="admin-cred-lifecycle-kwvkmn" in resourcegroup="admin-credential-lifecycle-test-h4bz6t" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-kwvkmn\" in resourcegroup=\"admin-credential-lifecycle-test-h4bz6t\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a8b2e0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
<*fmt.wrapErrors | 0xc0007de9f0>:
failed waiting for hcpCluster="admin-cred-lifecycle-kwvkmn" in resourcegroup="admin-credential-lifecycle-test-h4bz6t" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-kwvkmn\" in resourcegroup=\"admin-credential-lifecycle-test-h4bz6t\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a8b2e0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-kwvkmn in resource group admin-credential-lifecycle-test-h4bz6t",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
<*fmt.wrapErrors | 0xc000d74b10>:
failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-jqxbnn" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-jqxbnn\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a12210>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
<*fmt.wrapErrors | 0xc000d74b10>:
failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-jqxbnn" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-jqxbnn\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc000a12210>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-jqxbnn",
},
<context.deadlineExceededError>{},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapErrors | 0xc001488b40>:
failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-svgd9j" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-svgd9j\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0002ff5c0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j",
},
<context.deadlineExceededError>{},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
<*fmt.wrapErrors | 0xc001488b40>:
failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-svgd9j" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded
{
msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-svgd9j\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j, error: context deadline exceeded",
errs: [
<*errors.errorString | 0xc0002ff5c0>{
s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-svgd9j",
},
<context.deadlineExceededError>{},
],
}
occurredContributing tests (6)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: Conflict; detail message Cannot request credential while resource is "provisioning"; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | e2e | 2 | 8.33%2 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapError | 0xc00049ee40>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00147a210>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["3041"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/5f33cbb9-f37a-429b-bce1-8edaf9908424",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260305T021539Z:547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: AD38B254178B410585C028F8AB33DE1C Ref B: CH1AA2020610031 Ref C: 2026-03-05T02:15:35Z",
],
"Date": [
"Thu, 05 Mar 2026 02:15:38 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"b2ef27e1-1259-4b08-a852-40ef41f5feca",
],
"X-Ms-Correlation-Request-Id": [
"547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["319"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
},
Body: <*exported.nopClosingBytesReader | 0xc00049ece0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
<*fmt.wrapError | 0xc00049ee40>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-4v2vfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00147a210>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["3041"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/5f33cbb9-f37a-429b-bce1-8edaf9908424",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260305T021539Z:547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: AD38B254178B410585C028F8AB33DE1C Ref B: CH1AA2020610031 Ref C: 2026-03-05T02:15:35Z",
],
"Date": [
"Thu, 05 Mar 2026 02:15:38 GMT",
],
"Cache-Control": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Ms-Request-Id": [
"b2ef27e1-1259-4b08-a852-40ef41f5feca",
],
"X-Ms-Correlation-Request-Id": [
"547cbd7f-379b-40c1-bc2c-84c59906fb55",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Content-Length": ["319"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
},
Body: <*exported.nopClosingBytesReader | 0xc00049ece0>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc000d461a0>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014c8630>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Envoy-Upstream-Service-Time": ["24"],
"X-Ms-Correlation-Request-Id": [
"04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260304T114425Z:04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["316"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/75e212f8-cdc9-4ef9-961a-651c91f9ecd9",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"51931baa-6371-4efa-a708-4f0f312f1ca0",
],
"Date": [
"Wed, 04 Mar 2026 11:44:25 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 8417EFDD14874F8BB0E5237BA546D57F Ref B: CHI261140512040 Ref C: 2026-03-04T11:44:25Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d46000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
<*fmt.wrapError | 0xc000d461a0>:
failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential
--------------------------------------------------------------------------------
RESPONSE 409: 409 Conflict
ERROR CODE: Conflict
--------------------------------------------------------------------------------
{
"error": {
"code": "Conflict",
"message": "Cannot request credential while resource is \"provisioning\"",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"Conflict\",\n \"message\": \"Cannot request credential while resource is \\\"provisioning\\\"\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-l4v8j8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc0014c8630>{
ErrorCode: "Conflict",
StatusCode: 409,
RawResponse: {
Status: "409 Conflict",
StatusCode: 409,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Error-Code": ["Conflict"],
"X-Envoy-Upstream-Service-Time": ["24"],
"X-Ms-Correlation-Request-Id": [
"04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260304T114425Z:04a3d0b4-7658-4960-bd57-a56b1404d40f",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"Content-Length": ["316"],
"Expires": ["-1"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/75e212f8-cdc9-4ef9-961a-651c91f9ecd9",
],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Ms-Request-Id": [
"51931baa-6371-4efa-a708-4f0f312f1ca0",
],
"Date": [
"Wed, 04 Mar 2026 11:44:25 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Msedge-Ref": [
"Ref A: 8417EFDD14874F8BB0E5237BA546D57F Ref B: CHI261140512040 Ref C: 2026-03-04T11:44:25Z",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000d46000>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 114, 101, 113, 117, 101, 115, 116, 32, 99, 114, 101, 100, 101, 110, 116, 105, 97, 108, 32, 119, 104, 105, 108, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 92, 34, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 92, 34, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceededfull failure pattern: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 2 | 8.33%2 of 24 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 1: 0 · Mar 2: 1 · Mar 3: 0 · Mar 4: 0 · Mar 5: 1 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc001195460>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-zqs4nb" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-zqs4nb\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc001195460>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-zqs4nb" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-zqs4nb\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc0009152c0>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-w4wfkv" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-w4wfkv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:190]: Unexpected error:
<*fmt.wrapError | 0xc0009152c0>:
failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-w4wfkv" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-19-7\" for cluster \"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-w4wfkv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InternalServerError; detail message insufficient public IP address quota: required <count>, available <count>; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 4.17%1 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 5 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapError | 0xc0007439c0>:
failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-rggf4c" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"name": "b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"status": "Failed",
"startTime": "2026-03-04T11:42:32.91171511Z",
"endTime": "2026-03-04T11:45:01.618825129Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0007439a0>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000679c80>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114509Z:d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Msedge-Ref": [
"Ref A: C1EE60EB4B804177AABFC80DC74FA33E Ref B: CHI261140501054 Ref C: 2026-03-04T11:45:08Z",
],
"X-Ms-Correlation-Request-Id": [
"d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"Content-Length": ["498"],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/78cb4115-38f4-400a-a373-de90cb3f6447",
],
"X-Ms-Ratelimit-Remaining...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
<*fmt.wrapError | 0xc0007439c0>:
failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-rggf4c" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"name": "b1c8c857-485d-4a3c-b764-cd54b5d212a2",
"status": "Failed",
"startTime": "2026-03-04T11:42:32.91171511Z",
"endTime": "2026-03-04T11:45:01.618825129Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster autoscaling-hcp-cluster: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0007439a0>{
msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-rggf4c\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"name\": \"b1c8c857-485d-4a3c-b764-cd54b5d212a2\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:32.91171511Z\",\n \"endTime\": \"2026-03-04T11:45:01.618825129Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000679c80>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114509Z:d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Msedge-Ref": [
"Ref A: C1EE60EB4B804177AABFC80DC74FA33E Ref B: CHI261140501054 Ref C: 2026-03-04T11:45:08Z",
],
"X-Ms-Correlation-Request-Id": [
"d921fb07-cad8-47f3-beb6-14b898dd9e31",
],
"X-Content-Type-Options": ["nosniff"],
"Pragma": ["no-cache"],
"Content-Length": ["498"],
"X-Envoy-Upstream-Service-Time": ["11"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/78cb4115-38f4-400a-a373-de90cb3f6447",
],
"X-Ms-Ratelimit-Remaining...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0008963e0>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-4ljw7f" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd",
"name": "8e2e6926-ad32-404f-9710-045e248d82cd",
"status": "Failed",
"startTime": "2026-03-04T11:42:34.945511327Z",
"endTime": "2026-03-04T11:49:48.715948579Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008963c0>{
msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00128c5a0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["499"],
"X-Ms-Correlation-Request-Id": [
"8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114951Z:8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Wed, 04 Mar 2026 11:49:50 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/43fae7b6-ce0d-421e-b423-059eca2efbf5",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
<*fmt.wrapError | 0xc0008963e0>:
failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-4ljw7f" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd",
"name": "8e2e6926-ad32-404f-9710-045e248d82cd",
"status": "Failed",
"startTime": "2026-03-04T11:42:34.945511327Z",
"endTime": "2026-03-04T11:49:48.715948579Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 1"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc0008963c0>{
msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-4ljw7f\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"name\": \"8e2e6926-ad32-404f-9710-045e248d82cd\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:42:34.945511327Z\",\n \"endTime\": \"2026-03-04T11:49:48.715948579Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 1\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00128c5a0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["499"],
"X-Ms-Correlation-Request-Id": [
"8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114951Z:8649fcef-a89d-4ebe-a831-d5aa547b7859",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Date": [
"Wed, 04 Mar 2026 11:49:50 GMT",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/43fae7b6-ce0d-421e-b423-059eca2efbf5",
],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc000f06a60>:
failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster="list-test-cluster-p6lb7l" in resourcegroup="cluster-listing-dlgx6v" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87",
"name": "4019f702-1223-4f14-b6db-2e256f1f2a87",
"status": "Failed",
"startTime": "2026-03-04T11:40:19.135177985Z",
"endTime": "2026-03-04T11:45:00.015034663Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f06a40>{
msg: "failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00122cd20>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["19"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/8ffb5ba3-48ab-446c-a59c-3f9d09ee97a7",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114501Z:4d14fc79-c15b-43f1-b5fc-ec2ab314d07f",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Request-Id": [
"a63da353-17cb-482c-9907-e48691e47dad",
],
"Pragma": ["no-cache"],
"Content-Length": ["499"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Msedge-Ref": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
<*fmt.wrapError | 0xc000f06a60>:
failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster="list-test-cluster-p6lb7l" in resourcegroup="cluster-listing-dlgx6v" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87",
"name": "4019f702-1223-4f14-b6db-2e256f1f2a87",
"status": "Failed",
"startTime": "2026-03-04T11:40:19.135177985Z",
"endTime": "2026-03-04T11:45:00.015034663Z",
"error": {
"code": "InternalServerError",
"message": "insufficient public IP address quota: required 2, available 0"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster list-test-cluster-p6lb7l: failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000f06a40>{
msg: "failed waiting for cluster=\"list-test-cluster-p6lb7l\" in resourcegroup=\"cluster-listing-dlgx6v\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"name\": \"4019f702-1223-4f14-b6db-2e256f1f2a87\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:40:19.135177985Z\",\n \"endTime\": \"2026-03-04T11:45:00.015034663Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"insufficient public IP address quota: required 2, available 0\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc00122cd20>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["19"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/8ffb5ba3-48ab-446c-a59c-3f9d09ee97a7",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T114501Z:4d14fc79-c15b-43f1-b5fc-ec2ab314d07f",
],
"X-Content-Type-Options": ["nosniff"],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Request-Id": [
"a63da353-17cb-482c-9907-e48691e47dad",
],
"Pragma": ["no-cache"],
"Content-Length": ["499"],
"Content-Type": ["application/json"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"X-Msedge-Ref": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (5)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail code PublicIPCountLimitReached; detail message Cannot create more than 300 public IP addresses for this subscription in this region.; provi...full failure pattern: ERROR CODE: InternalServerError; detail code PublicIPCountLimitReached; detail message Cannot create more than 300 public IP addresses for this subscription in this region.; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 4.17%1 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 4 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
<*fmt.wrapError | 0xc001050900>:
failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-42hshj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"name": "6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"status": "Failed",
"startTime": "2026-03-04T11:27:28.76644337Z",
"endTime": "2026-03-04T11:33:55.189840009Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-42hshj\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"name\": \"6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:27:28.76644337Z\",\n \"endTime\": \"2026-03-04T11:33:55.189840009Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses f...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
<*fmt.wrapError | 0xc001050900>:
failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-42hshj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"name": "6ee8ec73-61b8-4344-ad00-bba98e2702a7",
"status": "Failed",
"startTime": "2026-03-04T11:27:28.76644337Z",
"endTime": "2026-03-04T11:33:55.189840009Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cidr-connectivity-test: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-42hshj\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"name\": \"6ee8ec73-61b8-4344-ad00-bba98e2702a7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:27:28.76644337Z\",\n \"endTime\": \"2026-03-04T11:33:55.189840009Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-4\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-5\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-42hshj--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi6tet62ut5t7l4015hb57ec6maei-6\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses f...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c090a0>:
failed to create HCP cluster node-limit-cluster: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-v554wg" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"name": "b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"status": "Failed",
"startTime": "2026-03-04T11:29:07.030229354Z",
"endTime": "2026-03-04T11:33:56.440551062Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-v554wg\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"name\": \"b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:29:07.030229354Z\",\n \"endTime\": \"2026-03-04T11:33:56.440551062Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
<*fmt.wrapError | 0xc000c090a0>:
failed to create HCP cluster node-limit-cluster: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-v554wg" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"name": "b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3",
"status": "Failed",
"startTime": "2026-03-04T11:29:07.030229354Z",
"endTime": "2026-03-04T11:33:56.440551062Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster node-limit-cluster: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-v554wg\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"name\": \"b6c96910-d9fe-4ee6-be6a-ddfe7e0aebc3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-03-04T11:29:07.030229354Z\",\n \"endTime\": \"2026-03-04T11:33:56.440551062Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-0\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-1\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-2\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\\\",\\n \\\"details\\\": []\\n }\\n}\\n--------------------------------------------------------------------------------\\n\\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-v554wg--managed/providers/Microsoft.Network/publicIPAddresses/2oqsj0l8tte65mugqrulb0nrcn5o984k-3\\n--------------------------------------------------------------------------------\\nRESPONSE 400: 400 Bad Request\\nERROR CODE: PublicIPCountLimitReached\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"PublicIPCountLimitReached\\\",\\n \\\"message\\\": \\\"Cannot create more than 300 public IP addresses for this subscription in this region.\...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129]: Unexpected error:
<*exported.ResponseError | 0xc001696270>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592",
"name": "0b35155f-1c87-4a27-b264-b5ffaf2df592",
"status": "Failed",
"startTime": "2026-03-04T11:27:10.141510238Z",
"endTime": "2026-03-04T11:33:01.507880583Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Content-Length": ["7006"],
"X-Ms-Request-Id": [
"8f5597b5-16fa-4df6-bd73-65ab0a1bb005",
],
"X-Envoy-Upstream-Service-Time": ["10"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Correlation-Request-Id": [
"bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/eec24277-b57a-425a-a5e4-071fef365907",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T113304Z:bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7BD958C08EC847A19E41507ED24FBCAF Ref B: CHI261140510034 Ref C: 2026-03-04T11:33:03Z",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 04 Mar 2026 11:33:03 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000e12000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 117, 107, 115, 111, 117, 116, 104, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 50, 55, 58, 49, 48, 46, 49, 52, 49, 53, 49, 48, 50, 51, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 51, 51, 58, 48, 49, 46, 53, 48, 55, 56, 56, 48, 53, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 80, 85, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129]: Unexpected error:
<*exported.ResponseError | 0xc001696270>:
GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b35155f-1c87-4a27-b264-b5ffaf2df592",
"name": "0b35155f-1c87-4a27-b264-b5ffaf2df592",
"status": "Failed",
"startTime": "2026-03-04T11:27:10.141510238Z",
"endTime": "2026-03-04T11:33:01.507880583Z",
"error": {
"code": "InternalServerError",
"message": "PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-0\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-2\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-3\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-4\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-5\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-6\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-7\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n\nPUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-42hl9p--managed/providers/Microsoft.Network/publicIPAddresses/2oqsi3dcu806c95qg7cc9io5migfbgq6-8\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: PublicIPCountLimitReached\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"PublicIPCountLimitReached\",\n \"message\": \"Cannot create more than 300 public IP addresses for this subscription in this region.\",\n \"details\": []\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Cache-Control": ["no-cache"],
"X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
"Content-Length": ["7006"],
"X-Ms-Request-Id": [
"8f5597b5-16fa-4df6-bd73-65ab0a1bb005",
],
"X-Envoy-Upstream-Service-Time": ["10"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Reads": ["3749"],
"X-Ms-Correlation-Request-Id": [
"bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/canadacentral/eec24277-b57a-425a-a5e4-071fef365907",
],
"X-Ms-Routing-Request-Id": [
"CANADACENTRAL:20260304T113304Z:bd0a002f-0f30-4cf8-91cd-38e2956ccb93",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 7BD958C08EC847A19E41507ED24FBCAF Ref B: CHI261140510034 Ref C: 2026-03-04T11:33:03Z",
],
"Pragma": ["no-cache"],
"Expires": ["-1"],
"X-Cache": ["CONFIG_NOCACHE"],
"Date": [
"Wed, 04 Mar 2026 11:33:03 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0xc000e12000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 52, 48, 51, 100, 57, 100, 101, 57, 45, 49, 51, 50, 98, 45, 52, 57, 55, 52, 45, 57, 52, 97, 53, 45, 53, 98, 55, 56, 98, 100, 102, 97, 49, 57, 49, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 117, 107, 115, 111, 117, 116, 104, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 48, 98, 51, 53, 49, 53, 53, 102, 45, 49, 99, 56, 55, 45, 52, 97, 50, 55, 45, 98, 50, 54, 52, 45, 98, 53, 102, 102, 97, 102, 50, 100, 102, 53, 57, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 50, 55, 58, 49, 48, 46, 49, 52, 49, 53, 49, 48, 50, 51, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 48, 51, 45, 48, 52, 84, 49, 49, 58, 51, 51, 58, 48, 49, 46, 53, 48, 55, 56, 56, 48, 53, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 80, 85, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 11...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (4)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle: Cluster provisioning failedfull failure pattern: Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle: Cluster provisioning failed Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 4.17%1 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 1 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 | DEV | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:153]: Cluster provisioning failed fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:153]: Cluster provisioning failed Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Value for field 'Issuer.CommonName' failed to satisfy matcher.full failure pattern: Value for field 'Issuer.CommonName' failed to satisfy matcher. Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 4.17%1 of 24 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 1: 0 · Mar 2: 0 · Mar 3: 0 · Mar 4: 0 · Mar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:149]: Timed out after 240.001s.
expect certificate to be issued by Microsoft
Value for field 'Issuer.CommonName' failed to satisfy matcher.
Expected
<string>: root-ca
to match regular expression
<string>: Microsoft\sAzure\sRSA\sTLS\sIssuing\sCA\s[0-9]+
fail [/go/pkg/mod/github.com/onsi/gomega@v1.39.1/internal/async_assertion.go:149]: Timed out after 240.001s.
expect certificate to be issued by Microsoft
Value for field 'Issuer.CommonName' failed to satisfy matcher.
Expected
<string>: root-ca
to match regular expression
<string>: Microsoft\sAzure\sRSA\sTLS\sIssuing\sCA\s[0-9]+Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||