No failure patterns match your search.
Environment: STG
Failure patterns: 3 · Failures matched: 4 · Total runs: 5 · Runs affected: 2
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ERROR CODE: ServiceUnavailable; detail message Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installa...full failure pattern: ERROR CODE: ServiceUnavailable; detail message Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 1 | 20.00%1 of 5 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsMar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 · Mar 23: 6 · Mar 24: 0 · Mar 25: 2 | none | ||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc000bec1c0>:
failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-6n2bks": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-6n2bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-tags-cluster: failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-6n2bks\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-6n2bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000bec1a0>{
msg: "failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-6n2bks\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-6n2bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000df6300>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Retry-After": ["59"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/be034bc4-d201-4cf4-b728-556fe0ade3f9",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Date": [
"Wed, 25 Mar 2026 19:20:24 GMT",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"3ccd5529-b470-48dc-a2fe-ced3f6fe5dd5",
],
"X-Ms-Failure-Cause": ["service"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 899AC6984BA846F6A65A8506E85AD96A Ref B: CHI261140511034 Ref C: 2026-03-25T19:20:19Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["257"],
"X-Envoy-Upstream-Service-Time": ["4648"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Expires": ["-1"],
"X-Ms-Correlation-Request-Id": [
"9e757052-2886-416e-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
<*fmt.wrapError | 0xc000bec1c0>:
failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-6n2bks": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-6n2bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster patch-tags-cluster: failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-6n2bks\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-6n2bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000bec1a0>{
msg: "failed starting cluster creation \"patch-tags-cluster\" in resourcegroup=\"patch-tags-6n2bks\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-6n2bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000df6300>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Retry-After": ["59"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/be034bc4-d201-4cf4-b728-556fe0ade3f9",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Date": [
"Wed, 25 Mar 2026 19:20:24 GMT",
],
"Pragma": ["no-cache"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"3ccd5529-b470-48dc-a2fe-ced3f6fe5dd5",
],
"X-Ms-Failure-Cause": ["service"],
"X-Cache": ["CONFIG_NOCACHE"],
"X-Msedge-Ref": [
"Ref A: 899AC6984BA846F6A65A8506E85AD96A Ref B: CHI261140511034 Ref C: 2026-03-25T19:20:19Z",
],
"Cache-Control": ["no-cache"],
"Content-Length": ["257"],
"X-Envoy-Upstream-Service-Time": ["4648"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Expires": ["-1"],
"X-Ms-Correlation-Request-Id": [
"9e757052-2886-416e-...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc000ad4120>:
failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-2nvstv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-2nvstv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-2nvstv\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-2nvstv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000ad4100>{
msg: "failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-2nvstv\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-2nvstv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000fca120>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7588"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Request-Id": [
"e8865110-76fd-4100-ac8b-61387f083b25",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260325T192115Z:c972a143-3485-47a2-9316-0276f2fe9c42",
],
"Cache-Control": ["no-cache"],
"Retry-After": ["59"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 80D5D109F1BA4D5AAB8CB91CE56B9D9A Ref B: CHI261140509025 Ref C: 2026-03-25T19:21:07Z",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/44ce2c96-32a8-470a-b768-16f9ab9bcbff",
],
"X-Ms-Correlation-Request-Id": [
"c972a143-3485-4...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
<*fmt.wrapError | 0xc000ad4120>:
failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-2nvstv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-2nvstv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128
--------------------------------------------------------------------------------
RESPONSE 503: 503 Service Unavailable
ERROR CODE: ServiceUnavailable
--------------------------------------------------------------------------------
{
"error": {
"code": "ServiceUnavailable",
"message": "Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-2nvstv\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-2nvstv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000ad4100>{
msg: "failed starting cluster creation \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-2nvstv\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-2nvstv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: ServiceUnavailable\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ServiceUnavailable\",\n \"message\": \"Cluster installation has failed due to unavailable capacity. While we are bringing on additional capacity, try your cluster installation in another region or try again later\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc000fca120>{
ErrorCode: "ServiceUnavailable",
StatusCode: 503,
RawResponse: {
Status: "503 Service Unavailable",
StatusCode: 503,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Expires": ["-1"],
"X-Envoy-Upstream-Service-Time": ["7588"],
"X-Ms-Failure-Cause": ["service"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"Pragma": ["no-cache"],
"Content-Length": ["257"],
"X-Ms-Error-Code": ["ServiceUnavailable"],
"X-Ms-Request-Id": [
"e8865110-76fd-4100-ac8b-61387f083b25",
],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260325T192115Z:c972a143-3485-47a2-9316-0276f2fe9c42",
],
"Cache-Control": ["no-cache"],
"Retry-After": ["59"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Msedge-Ref": [
"Ref A: 80D5D109F1BA4D5AAB8CB91CE56B9D9A Ref B: CHI261140509025 Ref C: 2026-03-25T19:21:07Z",
],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/44ce2c96-32a8-470a-b768-16f9ab9bcbff",
],
"X-Ms-Correlation-Request-Id": [
"c972a143-3485-4...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (2)
Affected runs (1)
| ||||||||||||||||||||||||
ERROR CODE: InvalidRequestContent; detail message Version 'openshift-v<version>' is disabled; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: InvalidRequestContent; detail message Version 'openshift-v<version>' is disabled; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 20.00%1 of 5 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 · Mar 23: 0 · Mar 24: 0 · Mar 25: 1 | none | ||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:95]: Unexpected error:
<*fmt.wrapError | 0xc000135720>:
failed to create HCP cluster cluster-zstream-4-19-t2pzfk: failed starting cluster creation "cluster-zstream-4-19-t2pzfk" in resourcegroup="rg-zstream-upgrade-4-19-jxxwdx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-19-jxxwdx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-19-t2pzfk
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Version 'openshift-v4.19.3-candidate' is disabled"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cluster-zstream-4-19-t2pzfk: failed starting cluster creation \"cluster-zstream-4-19-t2pzfk\" in resourcegroup=\"rg-zstream-upgrade-4-19-jxxwdx\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-19-jxxwdx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-19-t2pzfk\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Version 'openshift-v4.19.3-candidate' is disabled\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000135700>{
msg: "failed starting cluster creation \"cluster-zstream-4-19-t2pzfk\" in resourcegroup=\"rg-zstream-upgrade-4-19-jxxwdx\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-19-jxxwdx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-19-t2pzfk\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Version 'openshift-v4.19.3-candidate' is disabled\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001202ba0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Wed, 25 Mar 2026 02:11:45 GMT",
],
"Content-Length": ["136"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260325T021146Z:9c7634db-566c-41f7-8d72-2aa3ce322e48",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 721EFA18A062440EBE1322746807DA87 Ref B: CHI261140510040 Ref C: 2026-03-25T02:11:45Z",
],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"36238b70-47a0-49d4-8a7b-4444dbcf03d9",
],
"X-Envoy-Upstream-Service-Time": ["94"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/32b35b19-98a7-4612-8e9c-f53aba55c90f",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:95]: Unexpected error:
<*fmt.wrapError | 0xc000135720>:
failed to create HCP cluster cluster-zstream-4-19-t2pzfk: failed starting cluster creation "cluster-zstream-4-19-t2pzfk" in resourcegroup="rg-zstream-upgrade-4-19-jxxwdx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-19-jxxwdx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-19-t2pzfk
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: InvalidRequestContent
--------------------------------------------------------------------------------
{
"error": {
"code": "InvalidRequestContent",
"message": "Version 'openshift-v4.19.3-candidate' is disabled"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cluster-zstream-4-19-t2pzfk: failed starting cluster creation \"cluster-zstream-4-19-t2pzfk\" in resourcegroup=\"rg-zstream-upgrade-4-19-jxxwdx\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-19-jxxwdx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-19-t2pzfk\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Version 'openshift-v4.19.3-candidate' is disabled\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc000135700>{
msg: "failed starting cluster creation \"cluster-zstream-4-19-t2pzfk\" in resourcegroup=\"rg-zstream-upgrade-4-19-jxxwdx\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-19-jxxwdx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-19-t2pzfk\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Version 'openshift-v4.19.3-candidate' is disabled\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc001202ba0>{
ErrorCode: "InvalidRequestContent",
StatusCode: 400,
RawResponse: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Wed, 25 Mar 2026 02:11:45 GMT",
],
"Content-Length": ["136"],
"Expires": ["-1"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
"X-Ms-Routing-Request-Id": [
"UKSOUTH:20260325T021146Z:9c7634db-566c-41f7-8d72-2aa3ce322e48",
],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"X-Content-Type-Options": ["nosniff"],
"X-Msedge-Ref": [
"Ref A: 721EFA18A062440EBE1322746807DA87 Ref B: CHI261140510040 Ref C: 2026-03-25T02:11:45Z",
],
"Pragma": ["no-cache"],
"X-Ms-Error-Code": [
"InvalidRequestContent",
],
"X-Ms-Request-Id": [
"36238b70-47a0-49d4-8a7b-4444dbcf03d9",
],
"X-Envoy-Upstream-Service-Time": ["94"],
"X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
"Content-Type": ["application/json"],
"X-Ms-Operation-Identifier": [
"appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/32b35b19-98a7-4612-8e9c-f53aba55c90f",
],
"X-Cache": ["CONFIG_NOCACHE"],
"Cache-Control": ["no-cache"],
"X-Ms-Correlation-Request-Id": [
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||
tls: failed to verify certificate: x509: certificate signed by unknown authorityfull failure pattern: tls: failed to verify certificate: x509: certificate signed by unknown authority Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 1 | 20.00%1 of 5 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsMar 19: 0 · Mar 20: 0 · Mar 21: 0 · Mar 22: 0 · Mar 23: 0 · Mar 24: 0 · Mar 25: 1 | none | ||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:137]: Unexpected error:
<*fmt.wrapError | 0xc000637420>:
route host was never found: Get "https://agnhost-e2e-serving-app-nxlgf.apps.aro.e5l4y9o6k9c4o7e.kadt.uksouthstaging.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-nxlgf.apps.aro.e5l4y9o6k9c4o7e.kadt.uksouthstaging.aroapp-hcp.io\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc000ddae70>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-nxlgf.apps.aro.e5l4y9o6k9c4o7e.kadt.uksouthstaging.aroapp-hcp.io",
Err: <*tls.CertificateVerificationError | 0xc000ddae40>{
UnverifiedCertificates: [
{
Raw: [48, 130, 3, 252, 48, 130, 2, 228, 160, 3, 2, 1, 2, 2, 8, 99, 64, 47, 79, 215, 200, 164, 59, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 50, 53, 48, 50, 49, 54, 50, 49, 90, 23, 13, 50, 55, 48, 51, 50, 53, 48, 50, 49, 54, 50, 49, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 141, 241, 47, 239, 62, 253, 98, 49, 137, 235, 185, 74, 86, 196, 103, 131, 206, 39, 48, 77, 76, 111, 24, 181, 219, 27, 206, 133, 221, 141, 181, 51, 67, 196, 197, 174, 93, 201, 148, 41, 42, 132, 114, 223, 15, 125, 178, 202, 215, 86, 233, 146, 214, 18, 59, 80, 209, 246, 19, 50, 54, 174, 218, 52, 71, 91, 90, 16, 99, 86, 253, 104, 196, 99, 142, 18, 2, 145, 74, 63, 102, 52, 131, 5, 40, 104, 109, 75, 65, 36, 33, 177, 94, 124, 226, 88, 123, 56, 5, 150, 84, 114, 168, 154, 37, 189, 66, 67, 107, 87, 251, 138, 196, 86, 62, 167, 168, 233, 72, 67, 100, 247, 25, 242, 70, 238, 216, 155, 97, 53, 61, 177, 177, 60, 115, 157, 153, 13, 110, 247, 94, 46, 56, 117, 93, 169, 81, 173, 168, 69, 51, 112, 138, 117, 67, 173, 153, 224, 191, 36, 121, 49, 98, 133, 124, 68, 143, 233, 221, 159, 132, 202, 2, 74, 155, 255, 29, 200, 226, 105, 25, 50, 38, 70, 52, 145, 157, 52, 28, 239, 243, 87, 28, 131, 208, 237, 232, 212, 74, 145, 33, 46, 74, 56, 28, 103, 183, 89, 242, 58, 148, 7, 82, 14, 167, 228, 10, 113, 90, 28, 0, 35, 44, 149, 27, 84, 143, 232, 30, 115, 121, 187, 144, 44, 19, 16, 153, 241, 196, 130, 18, 149, 235, 50, 215, 66, 238, 243, 124, 77, 7, 206, 104, 178, 220, 95, 2, 3, 1, 0, 1, 163, 130, 1, 34, 48, 130, 1, 30, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 20, 223, 115, 140, 30, 53, 210, 171, 227, 91, 106, 67, 254, 185, 30, 184, 153, 109, 180, 244, 255, 215, 85, 97, 81, 23, 89, 176, 168, 171, 191, 149, 157, 6, 212, 41, 106, 38, 68, 14, 11, 92, 9, 78, 68, 95, 81, 20, 190, 16, 147, 200, 24, 89, 195, 6, 231, 37, 115, 113, 15, 238, 67, 242, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 74, 208, 108, 214, 165, 118, 38, 97, 81, 164, 223, 165, 38, 47, 30, 56, 252, 121, 209, 250, 225, 42, 169, 242, 147, 184, 173, 252, 82, 6, 243, 244, 116, 7, 44, 171, 1, 53, 6, 13, 50, 127, 103, 100, 219, 242, 231, 141, 249, 165, 235, 141, 17, 206, 109, 28, 119, 33, 32, 124, 204, 158, 77, 120, 48, 71, 6, 3, 85, 29, 17, 4, 64, 48, 62, 130, 60, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 101, 53, 108, 52, 121, 57, 111, 54, 107, 57, 99, 52, 111, 55, 101, 46, 107, 97, 100, 116, 46, 117, 107, 115, 111, 117, 116, 104, 115, 116, 97, 103, 105, 110, 103, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 105, 111, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 13, 1, 98, 31, 151, 215, 217, 129, 223, 198, 164, 43, 112, 111, 115, 255, 79, 166, 50, 156, 171, 37, 126, 122, 145, 48, 254, 197, 3, 135, 241, 241, 181, 186, ...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:137]: Unexpected error:
<*fmt.wrapError | 0xc000637420>:
route host was never found: Get "https://agnhost-e2e-serving-app-nxlgf.apps.aro.e5l4y9o6k9c4o7e.kadt.uksouthstaging.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "route host was never found: Get \"https://agnhost-e2e-serving-app-nxlgf.apps.aro.e5l4y9o6k9c4o7e.kadt.uksouthstaging.aroapp-hcp.io\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0xc000ddae70>{
Op: "Get",
URL: "https://agnhost-e2e-serving-app-nxlgf.apps.aro.e5l4y9o6k9c4o7e.kadt.uksouthstaging.aroapp-hcp.io",
Err: <*tls.CertificateVerificationError | 0xc000ddae40>{
UnverifiedCertificates: [
{
Raw: [48, 130, 3, 252, 48, 130, 2, 228, 160, 3, 2, 1, 2, 2, 8, 99, 64, 47, 79, 215, 200, 164, 59, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 38, 49, 18, 48, 16, 6, 3, 85, 4, 11, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 16, 48, 14, 6, 3, 85, 4, 3, 19, 7, 114, 111, 111, 116, 45, 99, 97, 48, 30, 23, 13, 50, 54, 48, 51, 50, 53, 48, 50, 49, 54, 50, 49, 90, 23, 13, 50, 55, 48, 51, 50, 53, 48, 50, 49, 54, 50, 49, 90, 48, 48, 49, 18, 48, 16, 6, 3, 85, 4, 10, 19, 9, 111, 112, 101, 110, 115, 104, 105, 102, 116, 49, 26, 48, 24, 6, 3, 85, 4, 3, 19, 17, 111, 112, 101, 110, 115, 104, 105, 102, 116, 45, 105, 110, 103, 114, 101, 115, 115, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 141, 241, 47, 239, 62, 253, 98, 49, 137, 235, 185, 74, 86, 196, 103, 131, 206, 39, 48, 77, 76, 111, 24, 181, 219, 27, 206, 133, 221, 141, 181, 51, 67, 196, 197, 174, 93, 201, 148, 41, 42, 132, 114, 223, 15, 125, 178, 202, 215, 86, 233, 146, 214, 18, 59, 80, 209, 246, 19, 50, 54, 174, 218, 52, 71, 91, 90, 16, 99, 86, 253, 104, 196, 99, 142, 18, 2, 145, 74, 63, 102, 52, 131, 5, 40, 104, 109, 75, 65, 36, 33, 177, 94, 124, 226, 88, 123, 56, 5, 150, 84, 114, 168, 154, 37, 189, 66, 67, 107, 87, 251, 138, 196, 86, 62, 167, 168, 233, 72, 67, 100, 247, 25, 242, 70, 238, 216, 155, 97, 53, 61, 177, 177, 60, 115, 157, 153, 13, 110, 247, 94, 46, 56, 117, 93, 169, 81, 173, 168, 69, 51, 112, 138, 117, 67, 173, 153, 224, 191, 36, 121, 49, 98, 133, 124, 68, 143, 233, 221, 159, 132, 202, 2, 74, 155, 255, 29, 200, 226, 105, 25, 50, 38, 70, 52, 145, 157, 52, 28, 239, 243, 87, 28, 131, 208, 237, 232, 212, 74, 145, 33, 46, 74, 56, 28, 103, 183, 89, 242, 58, 148, 7, 82, 14, 167, 228, 10, 113, 90, 28, 0, 35, 44, 149, 27, 84, 143, 232, 30, 115, 121, 187, 144, 44, 19, 16, 153, 241, 196, 130, 18, 149, 235, 50, 215, 66, 238, 243, 124, 77, 7, 206, 104, 178, 220, 95, 2, 3, 1, 0, 1, 163, 130, 1, 34, 48, 130, 1, 30, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 48, 12, 6, 3, 85, 29, 19, 1, 1, 255, 4, 2, 48, 0, 48, 73, 6, 3, 85, 29, 14, 4, 66, 4, 64, 20, 223, 115, 140, 30, 53, 210, 171, 227, 91, 106, 67, 254, 185, 30, 184, 153, 109, 180, 244, 255, 215, 85, 97, 81, 23, 89, 176, 168, 171, 191, 149, 157, 6, 212, 41, 106, 38, 68, 14, 11, 92, 9, 78, 68, 95, 81, 20, 190, 16, 147, 200, 24, 89, 195, 6, 231, 37, 115, 113, 15, 238, 67, 242, 48, 75, 6, 3, 85, 29, 35, 4, 68, 48, 66, 128, 64, 74, 208, 108, 214, 165, 118, 38, 97, 81, 164, 223, 165, 38, 47, 30, 56, 252, 121, 209, 250, 225, 42, 169, 242, 147, 184, 173, 252, 82, 6, 243, 244, 116, 7, 44, 171, 1, 53, 6, 13, 50, 127, 103, 100, 219, 242, 231, 141, 249, 165, 235, 141, 17, 206, 109, 28, 119, 33, 32, 124, 204, 158, 77, 120, 48, 71, 6, 3, 85, 29, 17, 4, 64, 48, 62, 130, 60, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 101, 53, 108, 52, 121, 57, 111, 54, 107, 57, 99, 52, 111, 55, 101, 46, 107, 97, 100, 116, 46, 117, 107, 115, 111, 117, 116, 104, 115, 116, 97, 103, 105, 110, 103, 46, 97, 114, 111, 97, 112, 112, 45, 104, 99, 112, 46, 105, 111, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 13, 1, 98, 31, 151, 215, 217, 129, 223, 198, 164, 43, 112, 111, 115, 255, 79, 166, 50, 156, 171, 37, 126, 122, 145, 48, 254, 197, 3, 135, 241, 241, 181, 186, ...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||