CIHealth Run Log

Environment: STG

Time (UTC)	Job	Failed at	Result	PR	Failed tests	Details
09:57:32	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
06:56:30	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	3	e2e (3) failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled 06:56:30 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc000da81c8>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-bbt9j2" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc000b35120>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000b35100>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000b350e0>{ msg: "failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc000da81c8>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-bbt9j2" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc000b35120>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000b35100>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000b350e0>{ msg: "failed waiting for hcpCluster=\"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-bbt9j2\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled 06:56:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc0017ea2e8>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-f85kxr" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc000d15e00>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000d15de0>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000d15dc0>{ msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc0017ea2e8>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-f85kxr" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc000d15e00>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000d15de0>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000d15dc0>{ msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-f85kxr\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift 06:56:30 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error: <fmt.wrapError \| 0xc000bea540>: failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-d9rlj5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1 -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000bea520>{ msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0012ae630>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Cache-Control": ["no-cache"], "Content-Type": ["application/json"], "Expires": ["-1"], "Retry-After": ["10"], "X-Envoy-Upstream-Service-Time": ["10019"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Msedge-Ref": [ "Ref A: ADF6D0781C9D48D8A5C81735B6310D6F Ref B: CHI261140512034 Ref C: 2026-03-13T07:15:12Z", ], "Date": [ "Fri, 13 Mar 2026 07:15:21 GMT", ], "X-Ms-Failure-Cause": ["service"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b3f3604-a2f9-4117-8f92-506228f3e7af", ], "Pragma": ["no-cache"], "Content-Length": ["186"], "X-Ms-Request-Id": [ "8c39947a-1214-430d-8010-f0929133b44f", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Correlation-Request-Id": [ "dafc4310-6617-45a5-b396-fc80a09e00a8", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error: <fmt.wrapError \| 0xc000bea540>: failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-d9rlj5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1 -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000bea520>{ msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-d9rlj5\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-d9rlj5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0012ae630>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Cache-Control": ["no-cache"], "Content-Type": ["application/json"], "Expires": ["-1"], "Retry-After": ["10"], "X-Envoy-Upstream-Service-Time": ["10019"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Msedge-Ref": [ "Ref A: ADF6D0781C9D48D8A5C81735B6310D6F Ref B: CHI261140512034 Ref C: 2026-03-13T07:15:12Z", ], "Date": [ "Fri, 13 Mar 2026 07:15:21 GMT", ], "X-Ms-Failure-Cause": ["service"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/6b3f3604-a2f9-4117-8f92-506228f3e7af", ], "Pragma": ["no-cache"], "Content-Length": ["186"], "X-Ms-Request-Id": [ "8c39947a-1214-430d-8010-f0929133b44f", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Correlation-Request-Id": [ "dafc4310-6617-45a5-b396-fc80a09e00a8", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred
03:03:30	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	4	e2e (4) VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4 03:03:30 UTC · failed at e2e · test Control plane automated z-stream upgrade with candidate channel should perform an automated control plane z-stream upgrade using the candidate channel · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.005s. Expected success, but got an error: <errors.joinError \| 0xc001085770>: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15" { errs: [ <fmt.wrapError \| 0xc000a12720>{ msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"", err: <errors.errorString \| 0xc0008a2660>{ s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"", }, }, ], } fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.005s. Expected success, but got an error: <errors.joinError \| 0xc001085770>: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15" { errs: [ <fmt.wrapError \| 0xc000a12720>{ msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"", err: <errors.errorString \| 0xc0008a2660>{ s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"", }, }, ], } ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift 03:03:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error: <errors.joinError \| 0xc000d300d8>: failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { errs: [ <fmt.wrapError \| 0xc000e024c0>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000e02480>{ msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000f90300>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Date": [ "Fri, 13 Mar 2026 03:19:28 GMT", ], "Cache-Control": ["no-cache"], "Pragma": ["no-cache"], "Retry-After": ["10"], "X-Envoy-Upstream-Service-Time": ["10022"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"], "X-Ms-Correlation-Request-Id": [ "8b4fb22e-bc20-46b1-8f98-d4392041161d", ], "X-Msedge-Ref": [ "Ref A: A9CAA84EC1294F488AB1EBE718FAA146 Ref B: CH1AA2020603009 Ref C: 2026-03-13T03:19:18Z", ], "Content-Length": ["186"], "Content-Type": ["application/json"], "X-Ms-Request-Id": [ "51a5e370-92d6-4444-ab52-1b5412da1e41", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c7e2a0d7-ccf1-4903-af7f-e49949aa8449", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T031929Z:8b4fb22e-bc20-46b1-8f98-d4392041161d", ], "Strict-Transport-Security": [ ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error: <errors.joinError \| 0xc000d300d8>: failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { errs: [ <fmt.wrapError \| 0xc000e024c0>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000e02480>{ msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-v4pw7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000f90300>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Date": [ "Fri, 13 Mar 2026 03:19:28 GMT", ], "Cache-Control": ["no-cache"], "Pragma": ["no-cache"], "Retry-After": ["10"], "X-Envoy-Upstream-Service-Time": ["10022"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"], "X-Ms-Correlation-Request-Id": [ "8b4fb22e-bc20-46b1-8f98-d4392041161d", ], "X-Msedge-Ref": [ "Ref A: A9CAA84EC1294F488AB1EBE718FAA146 Ref B: CH1AA2020603009 Ref C: 2026-03-13T03:19:18Z", ], "Content-Length": ["186"], "Content-Type": ["application/json"], "X-Ms-Request-Id": [ "51a5e370-92d6-4444-ab52-1b5412da1e41", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/c7e2a0d7-ccf1-4903-af7f-e49949aa8449", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T031929Z:8b4fb22e-bc20-46b1-8f98-d4392041161d", ], "Strict-Transport-Security": [ ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled 03:03:30 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc0015623f0>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-listcwcr6n" in resourcegroup="ea-list-kd7958" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc001681600>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc0016815e0>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc0016815c0>{ msg: "failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc0015623f0>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-listcwcr6n" in resourcegroup="ea-list-kd7958" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc001681600>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc0016815e0>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc0016815c0>{ msg: "failed waiting for hcpCluster=\"ea-listcwcr6n\" in resourcegroup=\"ea-list-kd7958\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift 03:03:30 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error: <errors.joinError \| 0xc000fd40f0>: failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { errs: [ <fmt.wrapError \| 0xc001786300>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc0017862e0>{ msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0013d0540>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Ratelimit-Remaining-Subscription-Deletes": ["199"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: CC4F23FE193F4C1FB16C204ED434C9F4 Ref B: CHI261140510042 Ref C: 2026-03-13T03:16:52Z", ], "Expires": ["-1"], "Retry-After": ["10"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/fbb98992-521d-40e7-b146-c0dfb4a73360", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"], "Date": [ "Fri, 13 Mar 2026 03:17:01 GMT", ], "Cache-Control": ["no-cache"], "Content-Type": ["application/json"], "X-Ms-Error-Code": ["LockContention"], "X-Ms-Correlation-Request-Id": [ "f2fd7682-45a9-47f9-a802-ee0323a08a2f", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T031702Z:f2fd7682-45a9-47f9-a802-ee0323a08a2f", ], ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error: <errors.joinError \| 0xc000fd40f0>: failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { errs: [ <fmt.wrapError \| 0xc001786300>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc0017862e0>{ msg: "at least one hcp cluster failed to delete: DELETE https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-26rkfj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0013d0540>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Ratelimit-Remaining-Subscription-Deletes": ["199"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: CC4F23FE193F4C1FB16C204ED434C9F4 Ref B: CHI261140510042 Ref C: 2026-03-13T03:16:52Z", ], "Expires": ["-1"], "Retry-After": ["10"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/fbb98992-521d-40e7-b146-c0dfb4a73360", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Deletes": ["2999"], "Date": [ "Fri, 13 Mar 2026 03:17:01 GMT", ], "Cache-Control": ["no-cache"], "Content-Type": ["application/json"], "X-Ms-Error-Code": ["LockContention"], "X-Ms-Correlation-Request-Id": [ "f2fd7682-45a9-47f9-a802-ee0323a08a2f", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T031702Z:f2fd7682-45a9-47f9-a802-ee0323a08a2f", ], ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred
01:35:36	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	13	e2e (13) ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:105]: Unexpected error: <fmt.wrapError \| 0xc000904180>: failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-p6hvnc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-p6hvnc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0010181b0>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Cache-Control": ["no-cache"], "Retry-After": ["10"], "X-Ms-Error-Code": ["LockContention"], "X-Envoy-Upstream-Service-Time": ["10022"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/92e064d1-9d4c-447f-bbeb-6cd4a09306c0", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "Date": [ "Fri, 13 Mar 2026 01:48:46 GMT", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "Pragma": ["no-cache"], "X-Ms-Failure-Cause": ["service"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014847Z:007f4e23-cda8-4a3a-bd9d-515d4b6657ce", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: 36CBE16C80904835A39C74AFB34066AA Ref B: CHI261140513062 Ref C: 2026-03-13T01:48:36Z", ], "Content-Length": ["186"], "Content-Type": ["application/json"], "Expires": ["-1"], "X-Ms-Request-Id": [ "5303d7f1-5473-4446-a816-799266bf7586", ], "X-Ms-Correlation-Request-Id": [ "007f4e23-cda8-4a3a-bd9d-515d4b6657ce", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Content-Type-Options": ["nosniff"], }, Body: <exported.nopClosingBytesReader \| 0xc000904040>{ s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125], i: 0, ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:105]: Unexpected error: <fmt.wrapError \| 0xc000904180>: failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-p6hvnc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential -------------------------------------------------------------------------------- RESPONSE 503: 503 Service Unavailable ERROR CODE: LockContention -------------------------------------------------------------------------------- { "error": { "code": "LockContention", "message": "Failed to acquire lock: timed out", "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" } } -------------------------------------------------------------------------------- { msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-p6hvnc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"LockContention\",\n \"message\": \"Failed to acquire lock: timed out\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0010181b0>{ ErrorCode: "LockContention", StatusCode: 503, RawResponse: { Status: "503 Service Unavailable", StatusCode: 503, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Cache-Control": ["no-cache"], "Retry-After": ["10"], "X-Ms-Error-Code": ["LockContention"], "X-Envoy-Upstream-Service-Time": ["10022"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/92e064d1-9d4c-447f-bbeb-6cd4a09306c0", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "Date": [ "Fri, 13 Mar 2026 01:48:46 GMT", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "Pragma": ["no-cache"], "X-Ms-Failure-Cause": ["service"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014847Z:007f4e23-cda8-4a3a-bd9d-515d4b6657ce", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: 36CBE16C80904835A39C74AFB34066AA Ref B: CHI261140513062 Ref C: 2026-03-13T01:48:36Z", ], "Content-Length": ["186"], "Content-Type": ["application/json"], "Expires": ["-1"], "X-Ms-Request-Id": [ "5303d7f1-5473-4446-a816-799266bf7586", ], "X-Ms-Correlation-Request-Id": [ "007f4e23-cda8-4a3a-bd9d-515d4b6657ce", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Content-Type-Options": ["nosniff"], }, Body: <exported.nopClosingBytesReader \| 0xc000904040>{ s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125], i: 0, ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: Unexpected error: <fmt.wrapError \| 0xc00069bb20>: failed to create NodePool autoscale-np: failed starting nodepool creation "autoscale-np" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-l8bvjr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-l8bvjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster/nodePools/autoscale-np -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool autoscale-np: failed starting nodepool creation \"autoscale-np\" for cluster \"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-l8bvjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-l8bvjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster/nodePools/autoscale-np\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc00069bb00>{ msg: "failed starting nodepool creation \"autoscale-np\" for cluster \"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-l8bvjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-l8bvjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster/nodePools/autoscale-np\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000cb1320>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Pragma": ["no-cache"], "Content-Type": ["application/json"], "X-Envoy-Upstream-Service-Time": ["9336"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Content-Type-Options": ["nosniff"], "X-Msedge-Ref": [ "Ref A: E9503FA110EC4778A8A4BB4872B35054 Ref B: CHI261140503031 Ref C: 2026-03-13T01:52:03Z", ], "Cache-Control": ["no-cache"], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "73adcbc6-d7f3-4985-a139-932b15750ade", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T015212Z:feb68b4b-ffb7-4123-9776-2a763ec77aa8", ], "Content-Length": ["170"], "Date": [ "Fri, 13 Mar 2026 01:52:12 GMT", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/40cbf404-4cb6-45c0-9c49-4a7729d09fec", ], "X-Ms-Correlatio... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: Unexpected error: <fmt.wrapError \| 0xc00069bb20>: failed to create NodePool autoscale-np: failed starting nodepool creation "autoscale-np" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-l8bvjr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-l8bvjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster/nodePools/autoscale-np -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool autoscale-np: failed starting nodepool creation \"autoscale-np\" for cluster \"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-l8bvjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-l8bvjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster/nodePools/autoscale-np\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc00069bb00>{ msg: "failed starting nodepool creation \"autoscale-np\" for cluster \"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-l8bvjr\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-l8bvjr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster/nodePools/autoscale-np\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000cb1320>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Pragma": ["no-cache"], "Content-Type": ["application/json"], "X-Envoy-Upstream-Service-Time": ["9336"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Content-Type-Options": ["nosniff"], "X-Msedge-Ref": [ "Ref A: E9503FA110EC4778A8A4BB4872B35054 Ref B: CHI261140503031 Ref C: 2026-03-13T01:52:03Z", ], "Cache-Control": ["no-cache"], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "73adcbc6-d7f3-4985-a139-932b15750ade", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T015212Z:feb68b4b-ffb7-4123-9776-2a763ec77aa8", ], "Content-Length": ["170"], "Date": [ "Fri, 13 Mar 2026 01:52:12 GMT", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/40cbf404-4cb6-45c0-9c49-4a7729d09fec", ], "X-Ms-Correlatio... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error: <fmt.wrapError \| 0xc000a81120>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-bstsh8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-bstsh8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-bstsh8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-bstsh8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000a81100>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-bstsh8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-bstsh8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000e0f9b0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Date": [ "Fri, 13 Mar 2026 01:48:57 GMT", ], "Cache-Control": ["no-cache"], "Content-Length": ["170"], "Expires": ["-1"], "X-Ms-Request-Id": [ "2507f603-c7de-4a8e-aa27-15e1609b0ac3", ], "X-Envoy-Upstream-Service-Time": ["8444"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Cache": ["CONFIG_NOCACHE"], "Content-Type": ["application/json"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/8519dbc4-4538-4f59-a9b5-1b3de6f79174", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Correlation-Request-Id": [ "f2ca1b86-8833-4fe4-8a08-78dfccbe96fc", ], "X-Msedge-Ref": [ "Ref A: 57CD9B8F384942F3A6BDA63C70922F96 Ref B: CHI261140501054 Ref C: 2026-03-13T01:48:48Z", ], "Pragma": ["no-cache"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Content-Type-Options": ["nosniff"], "X-Ms-Rout... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:145]: Unexpected error: <fmt.wrapError \| 0xc000a81120>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-bstsh8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-bstsh8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-bstsh8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-bstsh8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000a81100>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-bstsh8\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-bstsh8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000e0f9b0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Date": [ "Fri, 13 Mar 2026 01:48:57 GMT", ], "Cache-Control": ["no-cache"], "Content-Length": ["170"], "Expires": ["-1"], "X-Ms-Request-Id": [ "2507f603-c7de-4a8e-aa27-15e1609b0ac3", ], "X-Envoy-Upstream-Service-Time": ["8444"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Cache": ["CONFIG_NOCACHE"], "Content-Type": ["application/json"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/8519dbc4-4538-4f59-a9b5-1b3de6f79174", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Correlation-Request-Id": [ "f2ca1b86-8833-4fe4-8a08-78dfccbe96fc", ], "X-Msedge-Ref": [ "Ref A: 57CD9B8F384942F3A6BDA63C70922F96 Ref B: CHI261140501054 Ref C: 2026-03-13T01:48:48Z", ], "Pragma": ["no-cache"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Content-Type-Options": ["nosniff"], "X-Ms-Rout... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error: <fmt.wrapError \| 0xc000e8ccc0>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-wbj7ss": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-wbj7ss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-wbj7ss\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-wbj7ss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000e8cca0>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-wbj7ss\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-wbj7ss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0013b9800>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Correlation-Request-Id": [ "aac37c71-4de5-4299-a42e-be58b9d28ac5", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014900Z:aac37c71-4de5-4299-a42e-be58b9d28ac5", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Msedge-Ref": [ "Ref A: 0F3CAB9171E8460A8DA01058BBA3724D Ref B: CHI261140503042 Ref C: 2026-03-13T01:48:55Z", ], "X-Ms-Request-Id": [ "04269cb2-646e-41ff-97ae-4fb4084fe36d", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Content-Type-Options": ["nosniff"], "X-Cache": ["CONFIG_NOCACHE"], "Date": [ "Fri, 13 Mar 2026 01:48:59 GMT", ], "Content-Length": ["170"], "X-Envoy-Upstream-Service-Time": ["4407"], "Cache-Control": ["no-cache"], "Pragma": ["no-cache"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "Content-Type": ["application/json"], "Expires": ["-1"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantI... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error: <fmt.wrapError \| 0xc000e8ccc0>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-wbj7ss": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-wbj7ss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-wbj7ss\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-wbj7ss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000e8cca0>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-wbj7ss\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-wbj7ss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0013b9800>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Correlation-Request-Id": [ "aac37c71-4de5-4299-a42e-be58b9d28ac5", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014900Z:aac37c71-4de5-4299-a42e-be58b9d28ac5", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Msedge-Ref": [ "Ref A: 0F3CAB9171E8460A8DA01058BBA3724D Ref B: CHI261140503042 Ref C: 2026-03-13T01:48:55Z", ], "X-Ms-Request-Id": [ "04269cb2-646e-41ff-97ae-4fb4084fe36d", ], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Content-Type-Options": ["nosniff"], "X-Cache": ["CONFIG_NOCACHE"], "Date": [ "Fri, 13 Mar 2026 01:48:59 GMT", ], "Content-Length": ["170"], "X-Envoy-Upstream-Service-Time": ["4407"], "Cache-Control": ["no-cache"], "Pragma": ["no-cache"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "Content-Type": ["application/json"], "Expires": ["-1"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantI... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:114]: Unexpected error: <fmt.wrapError \| 0xc000f15b40>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-rss9cn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-rss9cn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-rss9cn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-rss9cn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000f15b20>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-rss9cn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-rss9cn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000d6d6b0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Pragma": ["no-cache"], "Content-Type": ["application/json"], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/17dfe115-970d-43f8-ba8d-2ddc07d4f0a8", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014811Z:beb49f74-d07b-4afd-a267-abf6606eda87", ], "X-Content-Type-Options": ["nosniff"], "Content-Length": ["170"], "X-Ms-Request-Id": [ "c9fcc111-eb4f-475e-968b-fbc8ab2fbd06", ], "Date": [ "Fri, 13 Mar 2026 01:48:11 GMT", ], "Cache-Control": ["no-cache"], "X-Envoy-Upstream-Service-Time": ["4412"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Correlation-Request-Id": [ "beb49f74-d07b-4afd-a267-abf6606eda87", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:114]: Unexpected error: <fmt.wrapError \| 0xc000f15b40>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-rss9cn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-rss9cn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-rss9cn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-rss9cn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000f15b20>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"tls-endpoint-hcp-cluster\" in resourcegroup=\"tls-endpoint-cluster-rss9cn\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-rss9cn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000d6d6b0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Pragma": ["no-cache"], "Content-Type": ["application/json"], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/17dfe115-970d-43f8-ba8d-2ddc07d4f0a8", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014811Z:beb49f74-d07b-4afd-a267-abf6606eda87", ], "X-Content-Type-Options": ["nosniff"], "Content-Length": ["170"], "X-Ms-Request-Id": [ "c9fcc111-eb4f-475e-968b-fbc8ab2fbd06", ], "Date": [ "Fri, 13 Mar 2026 01:48:11 GMT", ], "Cache-Control": ["no-cache"], "X-Envoy-Upstream-Service-Time": ["4412"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Ms-Correlation-Request-Id": [ "beb49f74-d07b-4afd-a267-abf6606eda87", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error: <fmt.wrapError \| 0xc00061c6e0>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-s58clz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc00061c680>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000c48660>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Msedge-Ref": [ "Ref A: 464A75CC61A1478A90E29E6DFB49BE37 Ref B: CH1AA2020610029 Ref C: 2026-03-13T01:49:31Z", ], "Content-Length": ["170"], "Content-Type": ["application/json"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "aed4189a-5711-491e-8bb6-acfacec34220", ], "X-Envoy-Upstream-Service-Time": ["286"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014932Z:5707dfab-8c93-438a-85f8-fe0b471a077a", ], "X-Cache": ["CONFIG_NOCACHE"], "Pragma": ["no-cache"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/307313a4-b300-4bb0-b030-114e8e644174", ], "Date": [ "Fri, 13 Mar 2026 01:49:31 GMT", ], "Cache-Control": ["no-cache"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Content-Type-Options": ["nosniff"], "Expires": ["-1"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Correlation-Request-Id": [ "5707dfab-8c93-438a-85f8-fe0b471a077a", ], "Strict-Transpo... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:118]: Unexpected error: <fmt.wrapError \| 0xc00061c6e0>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "basic-hcp-cluster" in resourcegroup="basic-cluster-s58clz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc00061c680>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-s58clz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-s58clz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000c48660>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Msedge-Ref": [ "Ref A: 464A75CC61A1478A90E29E6DFB49BE37 Ref B: CH1AA2020610029 Ref C: 2026-03-13T01:49:31Z", ], "Content-Length": ["170"], "Content-Type": ["application/json"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "aed4189a-5711-491e-8bb6-acfacec34220", ], "X-Envoy-Upstream-Service-Time": ["286"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014932Z:5707dfab-8c93-438a-85f8-fe0b471a077a", ], "X-Cache": ["CONFIG_NOCACHE"], "Pragma": ["no-cache"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/307313a4-b300-4bb0-b030-114e8e644174", ], "Date": [ "Fri, 13 Mar 2026 01:49:31 GMT", ], "Cache-Control": ["no-cache"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Content-Type-Options": ["nosniff"], "Expires": ["-1"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Correlation-Request-Id": [ "5707dfab-8c93-438a-85f8-fe0b471a077a", ], "Strict-Transpo... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error: <fmt.wrapError \| 0xc000846a80>: failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-vl7z5w": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-vl7z5w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-vl7z5w\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-vl7z5w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000846a60>{ msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-vl7z5w\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-vl7z5w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000df7770>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014856Z:1a1cbf19-1b9e-46c8-89ab-8411e2c5d615", ], "Content-Length": ["170"], "Expires": ["-1"], "X-Ms-Request-Id": [ "707fc091-7570-40fa-9b8d-637a33ac1651", ], "X-Envoy-Upstream-Service-Time": ["371"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/a75e2650-6af3-4df5-99a6-8eb6c0dfe46b", ], "X-Ms-Correlation-Request-Id": [ "1a1cbf19-1b9e-46c8-89ab-8411e2c5d615", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: 9473FFB62E2F4FE990ABA3F0D59EB064 Ref B: CHI261140506052 Ref C: 2026-03-13T01:48:56Z", ], "Content-Type": ["application/json"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Content-Type-Options": ["nosniff"], "Date": [ "Fri, 13 Mar 2026 01:48:56 GMT", ], "Cache-Control": ["no-cache"], "Pragma": ["no-... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error: <fmt.wrapError \| 0xc000846a80>: failed to create NodePool arm64-vm-np-1: failed starting nodepool creation "arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-vl7z5w": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-vl7z5w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool arm64-vm-np-1: failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-vl7z5w\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-vl7z5w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000846a60>{ msg: "failed starting nodepool creation \"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-vl7z5w\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-vl7z5w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster/nodePools/arm64-vm-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000df7770>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014856Z:1a1cbf19-1b9e-46c8-89ab-8411e2c5d615", ], "Content-Length": ["170"], "Expires": ["-1"], "X-Ms-Request-Id": [ "707fc091-7570-40fa-9b8d-637a33ac1651", ], "X-Envoy-Upstream-Service-Time": ["371"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/a75e2650-6af3-4df5-99a6-8eb6c0dfe46b", ], "X-Ms-Correlation-Request-Id": [ "1a1cbf19-1b9e-46c8-89ab-8411e2c5d615", ], "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: 9473FFB62E2F4FE990ABA3F0D59EB064 Ref B: CHI261140506052 Ref C: 2026-03-13T01:48:56Z", ], "Content-Type": ["application/json"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Content-Type-Options": ["nosniff"], "Date": [ "Fri, 13 Mar 2026 01:48:56 GMT", ], "Cache-Control": ["no-cache"], "Pragma": ["no-... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:242]: Unexpected error: <fmt.wrapError \| 0xc000fde660>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-nk4kcz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nk4kcz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-nk4kcz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nk4kcz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000fde640>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-nk4kcz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nk4kcz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0009ed3e0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Correlation-Request-Id": [ "77a9b5c9-69e2-457b-98ed-6dae18a6e331", ], "X-Content-Type-Options": ["nosniff"], "Cache-Control": ["no-cache"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Envoy-Upstream-Service-Time": ["322"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/232e2a7e-bdeb-4268-a201-e3c403ed29a4", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T015516Z:77a9b5c9-69e2-457b-98ed-6dae18a6e331", ], "X-Msedge-Ref": [ "Ref A: 2BCD65DE6DC24D84B80E67A4D8252D06 Ref B: CHI261140502052 Ref C: 2026-03-13T01:55:15Z", ], "Pragma": ["no-cache"], "X-Ms-Request-Id": [ "38f49749-5f90-43ea-a126-11b897753162", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Cache": ["CONFIG_NOCACHE"], "Content-Length": ["170"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Date": [ "Fr... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:242]: Unexpected error: <fmt.wrapError \| 0xc000fde660>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-nk4kcz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nk4kcz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-nk4kcz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nk4kcz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000fde640>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-nk4kcz\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nk4kcz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0009ed3e0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Correlation-Request-Id": [ "77a9b5c9-69e2-457b-98ed-6dae18a6e331", ], "X-Content-Type-Options": ["nosniff"], "Cache-Control": ["no-cache"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Envoy-Upstream-Service-Time": ["322"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/232e2a7e-bdeb-4268-a201-e3c403ed29a4", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T015516Z:77a9b5c9-69e2-457b-98ed-6dae18a6e331", ], "X-Msedge-Ref": [ "Ref A: 2BCD65DE6DC24D84B80E67A4D8252D06 Ref B: CHI261140502052 Ref C: 2026-03-13T01:55:15Z", ], "Pragma": ["no-cache"], "X-Ms-Request-Id": [ "38f49749-5f90-43ea-a126-11b897753162", ], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Cache": ["CONFIG_NOCACHE"], "Content-Length": ["170"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Date": [ "Fr... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error: <fmt.wrapError \| 0xc000d94240>: failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-8cnnck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000d94220>{ msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0011dc330>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: CE27CC750B4F4A1099A8FE01F39FD561 Ref B: CHI261140504029 Ref C: 2026-03-13T01:48:41Z", ], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "3a2f44cb-0316-432e-9f20-f948736553c2", ], "X-Ms-Correlation-Request-Id": [ "e54bd54b-460d-43e4-a17a-c650ba3ec54f", ], "X-Envoy-Upstream-Service-Time": ["3358"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/26c75988-1220-4415-af03-21c025e4c013", ], "Date": [ "Fri, 13 Mar 2026 01:48:44 GMT", ], "Cache-Control": ["no-cache"], "Content-Length": ["170"], "Content-Type": ["application/json"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014844Z:e54bd54b-460d-43e4-a17a-c650ba3ec54f", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "P... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error: <fmt.wrapError \| 0xc000d94240>: failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-8cnnck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000d94220>{ msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-8cnnck\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-8cnnck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0011dc330>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Cache": ["CONFIG_NOCACHE"], "X-Msedge-Ref": [ "Ref A: CE27CC750B4F4A1099A8FE01F39FD561 Ref B: CHI261140504029 Ref C: 2026-03-13T01:48:41Z", ], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "3a2f44cb-0316-432e-9f20-f948736553c2", ], "X-Ms-Correlation-Request-Id": [ "e54bd54b-460d-43e4-a17a-c650ba3ec54f", ], "X-Envoy-Upstream-Service-Time": ["3358"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/26c75988-1220-4415-af03-21c025e4c013", ], "Date": [ "Fri, 13 Mar 2026 01:48:44 GMT", ], "Cache-Control": ["no-cache"], "Content-Length": ["170"], "Content-Type": ["application/json"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014844Z:e54bd54b-460d-43e4-a17a-c650ba3ec54f", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "P... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4 01:35:36 UTC · failed at e2e · test Control plane automated z-stream upgrade with candidate channel should perform an automated control plane z-stream upgrade using the candidate channel · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.009s. Expected success, but got an error: <errors.joinError \| 0xc0011582e8>: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15" { errs: [ <fmt.wrapError \| 0xc000ac67c0>{ msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"", err: <errors.errorString \| 0xc0001427d0>{ s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"", }, }, ], } fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: Timed out after 2400.009s. Expected success, but got an error: <errors.joinError \| 0xc0011582e8>: VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial "4.20.15" { errs: [ <fmt.wrapError \| 0xc000ac67c0>{ msg: "VerifyHostedControlPlaneZStreamUpgradeOnly(initial=4.20.15) failed: no version in clusterversion/version status.history is greater than initial \"4.20.15\"", err: <errors.errorString \| 0xc0001427d0>{ s: "no version in clusterversion/version status.history is greater than initial \"4.20.15\"", }, }, ], } ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:120]: Unexpected error: <fmt.wrapError \| 0xc00139d480>: failed to create NodePool ea-np-1: failed starting nodepool creation "ea-np-1" for cluster "ea-cluster" in resourcegroup="external-auth-cluster-vbpkgm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-vbpkgm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/nodePools/ea-np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool ea-np-1: failed starting nodepool creation \"ea-np-1\" for cluster \"ea-cluster\" in resourcegroup=\"external-auth-cluster-vbpkgm\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-vbpkgm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/nodePools/ea-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc00139d460>{ msg: "failed starting nodepool creation \"ea-np-1\" for cluster \"ea-cluster\" in resourcegroup=\"external-auth-cluster-vbpkgm\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-vbpkgm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/nodePools/ea-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000bb9f20>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Cache": ["CONFIG_NOCACHE"], "Cache-Control": ["no-cache"], "X-Envoy-Upstream-Service-Time": ["2374"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Correlation-Request-Id": [ "adb03243-46c0-4e79-a28d-f32262b2488b", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Content-Length": ["170"], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Msedge-Ref": [ "Ref A: 44DAEE17542E44D88CBC6D515E16A64C Ref B: CHI261140502062 Ref C: 2026-03-13T01:48:42Z", ], "Date": [ "Fri, 13 Mar 2026 01:48:44 GMT", ], "Pragma": ["no-cache"], "X-Ms-Request-Id": [ "6cc083b8-1ef9-4b25-bbc0-616c037fdbb1", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014845Z:adb03243-46c0-4e79-a28d-f32262b2488b", ], "X-Content-Type-Options": ["nosniff"], "Content-Type": ["application/json"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=93b21e64-4824-439a-b893-46c... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:120]: Unexpected error: <fmt.wrapError \| 0xc00139d480>: failed to create NodePool ea-np-1: failed starting nodepool creation "ea-np-1" for cluster "ea-cluster" in resourcegroup="external-auth-cluster-vbpkgm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-vbpkgm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/nodePools/ea-np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool ea-np-1: failed starting nodepool creation \"ea-np-1\" for cluster \"ea-cluster\" in resourcegroup=\"external-auth-cluster-vbpkgm\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-vbpkgm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/nodePools/ea-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc00139d460>{ msg: "failed starting nodepool creation \"ea-np-1\" for cluster \"ea-cluster\" in resourcegroup=\"external-auth-cluster-vbpkgm\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-vbpkgm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster/nodePools/ea-np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc000bb9f20>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "X-Cache": ["CONFIG_NOCACHE"], "Cache-Control": ["no-cache"], "X-Envoy-Upstream-Service-Time": ["2374"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Correlation-Request-Id": [ "adb03243-46c0-4e79-a28d-f32262b2488b", ], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Content-Length": ["170"], "Expires": ["-1"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Msedge-Ref": [ "Ref A: 44DAEE17542E44D88CBC6D515E16A64C Ref B: CHI261140502062 Ref C: 2026-03-13T01:48:42Z", ], "Date": [ "Fri, 13 Mar 2026 01:48:44 GMT", ], "Pragma": ["no-cache"], "X-Ms-Request-Id": [ "6cc083b8-1ef9-4b25-bbc0-616c037fdbb1", ], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014845Z:adb03243-46c0-4e79-a28d-f32262b2488b", ], "X-Content-Type-Options": ["nosniff"], "Content-Type": ["application/json"], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=93b21e64-4824-439a-b893-46c... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled 01:35:36 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc000ef4a38>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-4tpb7n" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc0016a3a00>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"customer-rg-4tpb7n\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc0016a39e0>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"customer-rg-4tpb7n\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000d92120>{ msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"customer-rg-4tpb7n\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc000ef4a38>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-4tpb7n" to finish deleting: context canceled { errs: [ <fmt.wrapError \| 0xc0016a3a00>{ msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"customer-rg-4tpb7n\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc0016a39e0>{ msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"customer-rg-4tpb7n\" to finish deleting: context canceled", err: <fmt.wrapError \| 0xc000d92120>{ msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"customer-rg-4tpb7n\" to finish deleting: context canceled", err: <errors.errorString \| 0xb08a0c0>{ s: "context canceled", }, }, }, }, ], } occurred fail [:0]: A node timeout occurred ERROR CODE: InvalidRequestContent; detail message node pool <nodepool> '4.20.15' must not be greater than Control Plane version '4.20.8'; provider Microsoft.RedHatOpenShift 01:35:36 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error: <fmt.wrapError \| 0xc000a03e00>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-fph99j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000a03de0>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0015b46f0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Content-Type": ["application/json"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Content-Length": ["170"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "Cache-Control": ["no-cache"], "Pragma": ["no-cache"], "Expires": ["-1"], "X-Envoy-Upstream-Service-Time": ["2485"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014759Z:b223bd31-5124-4336-8659-d621923b7581", ], "X-Content-Type-Options": ["nosniff"], "X-Cache": ["CONFIG_NOCACHE"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "985c3873-8557-481e-b7da-f41abf57b299", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/223eff5f-1b5c-4425-89eb-063d6fc5f956", ], "X-Ms-Correlation-Request-Id": [ "b223bd31-5124-4336-8659-d621923b7581", ], "X-Msedge-Ref": [ "Ref A: B9DD73C420794F7A8138A30F859A721A Ref B: CHI261140505042 Ref C: 2026-03-13T01:47:56Z", ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:102]: Unexpected error: <fmt.wrapError \| 0xc000a03e00>: failed to create NodePool np-1: failed starting nodepool creation "np-1" for cluster "negative-tests-cluster" in resourcegroup="rg-negative-tests-fph99j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1 -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'" } } -------------------------------------------------------------------------------- { msg: "failed to create NodePool np-1: failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <fmt.wrapError \| 0xc000a03de0>{ msg: "failed starting nodepool creation \"np-1\" for cluster \"negative-tests-cluster\" in resourcegroup=\"rg-negative-tests-fph99j\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-fph99j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/nodePools/np-1\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Node pool version '4.20.15' must not be greater than Control Plane version '4.20.8'\"\n }\n}\n--------------------------------------------------------------------------------\n", err: <exported.ResponseError \| 0xc0015b46f0>{ ErrorCode: "InvalidRequestContent", StatusCode: 400, RawResponse: { Status: "400 Bad Request", StatusCode: 400, Proto: "HTTP/2.0", ProtoMajor: 2, ProtoMinor: 0, Header: { "Content-Type": ["application/json"], "Strict-Transport-Security": [ "max-age=31536000; includeSubDomains", ], "Content-Length": ["170"], "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"], "Cache-Control": ["no-cache"], "Pragma": ["no-cache"], "Expires": ["-1"], "X-Envoy-Upstream-Service-Time": ["2485"], "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"], "X-Ms-Routing-Request-Id": [ "UKSOUTH:20260313T014759Z:b223bd31-5124-4336-8659-d621923b7581", ], "X-Content-Type-Options": ["nosniff"], "X-Cache": ["CONFIG_NOCACHE"], "X-Ms-Error-Code": [ "InvalidRequestContent", ], "X-Ms-Request-Id": [ "985c3873-8557-481e-b7da-f41abf57b299", ], "X-Ms-Operation-Identifier": [ "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/223eff5f-1b5c-4425-89eb-063d6fc5f956", ], "X-Ms-Correlation-Request-Id": [ "b223bd31-5124-4336-8659-d621923b7581", ], "X-Msedge-Ref": [ "Ref A: B9DD73C420794F7A8138A30F859A721A Ref B: CHI261140505042 Ref C: 2026-03-13T01:47:56Z", ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output occurred