<
Single Day: Mar 30
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: STG

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 3
e2e (3)
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:48:38 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc001380270>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-5qfzqk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-5qfzqk, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-5qfzqk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-5qfzqk, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010e41b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-5qfzqk",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc001380270>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-5qfzqk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-5qfzqk, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-5qfzqk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-5qfzqk, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010e41b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-5qfzqk",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:48:38 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc000f88120>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="e2e-cilium-6npjkh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-6npjkh, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cilium-cluster\" in resourcegroup=\"e2e-cilium-6npjkh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-6npjkh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001038e50>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-6npjkh",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc000f88120>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="e2e-cilium-6npjkh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-6npjkh, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cilium-cluster\" in resourcegroup=\"e2e-cilium-6npjkh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-6npjkh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001038e50>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-6npjkh",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
add password: error status code received from the API
23:48:38 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:252]: Unexpected error:
    <*fmt.wrapError | 0xc000e25420>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc00063e4e0>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"East US\",\"Slice\":\"E\",\"Ring\":\"5\",\"ScaleUnit\":\"007\",\"RoleInstance\":\"MN1PEPF00028332\"}}": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Tue, 31 Mar 2026 00:21:31 GMT": {},
                            },
                            "vary": {
                                "Accept-Encoding": {},
                            },
                            "request-id": {
                                "061ef776-ae17-49c6-bbac-b0d62d7d9704": {},
                            },
                            "cache-control": {"no-cache": {}},
                            "content-type": {
                                "application/json": {},
                            },
                            "client-request-id": {
                                "061ef776-ae17-49c6-bbac-b0d62d7d9704": {},
                            },
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000e253c0>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc000d26ce0>{
                        backingStore: <*store.InMemoryBackingStore | 0xc000e253e0>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "code": <*string | 0xc000d26b60>"Request_ResourceNotFound",
                                "message": <*string | 0xc000d26bb0>"Resource '02691b9b-c5f7-45b0-9cff-7fc2c9805fcd' does not exist or one of its queried reference-property objects are not present.",
                                "innerError": <*odataerrors.InnerError | 0xc000d26d40>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc000e25400>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                            },
                            subscribers: {},
                            changedValues: {"code": false, "message": false, "innerError": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:252]: Unexpected error:
    <*fmt.wrapError | 0xc000e25420>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc00063e4e0>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"East US\",\"Slice\":\"E\",\"Ring\":\"5\",\"ScaleUnit\":\"007\",\"RoleInstance\":\"MN1PEPF00028332\"}}": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Tue, 31 Mar 2026 00:21:31 GMT": {},
                            },
                            "vary": {
                                "Accept-Encoding": {},
                            },
                            "request-id": {
                                "061ef776-ae17-49c6-bbac-b0d62d7d9704": {},
                            },
                            "cache-control": {"no-cache": {}},
                            "content-type": {
                                "application/json": {},
                            },
                            "client-request-id": {
                                "061ef776-ae17-49c6-bbac-b0d62d7d9704": {},
                            },
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000e253c0>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc000d26ce0>{
                        backingStore: <*store.InMemoryBackingStore | 0xc000e253e0>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "code": <*string | 0xc000d26b60>"Request_ResourceNotFound",
                                "message": <*string | 0xc000d26bb0>"Resource '02691b9b-c5f7-45b0-9cff-7fc2c9805fcd' does not exist or one of its queried reference-property objects are not present.",
                                "innerError": <*odataerrors.InnerError | 0xc000d26d40>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc000e25400>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                            },
                            subscribers: {},
                            changedValues: {"code": false, "message": false, "innerError": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 3
e2e (3)
timeout during CreateHCPClusterAndWait; context deadline exceeded
20:54:03 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:136]: Unexpected error:
    <*fmt.wrapErrors | 0xc001592f30>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-dds6fm" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-dds6fm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010eca30>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm",
            },
            <*fmt.wrapErrors | 0xc001592f00>{
                msg: "failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-dds6fm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0010eca30>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:136]: Unexpected error:
    <*fmt.wrapErrors | 0xc001592f30>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-dds6fm" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-dds6fm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010eca30>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm",
            },
            <*fmt.wrapErrors | 0xc001592f00>{
                msg: "failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-dds6fm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0010eca30>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-dds6fm",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
20:54:03 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc0006da630>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-45j7m6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-45j7m6, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-45j7m6\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-45j7m6, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f9d270>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-45j7m6",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc0006da630>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-45j7m6" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-45j7m6, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-45j7m6\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-45j7m6, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f9d270>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-45j7m6",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
20:54:03 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fee7b0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="e2e-cilium-v5qllt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-v5qllt, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cilium-cluster\" in resourcegroup=\"e2e-cilium-v5qllt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-v5qllt, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0015684b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-v5qllt",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fee7b0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="e2e-cilium-v5qllt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-v5qllt, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cilium-cluster\" in resourcegroup=\"e2e-cilium-v5qllt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-v5qllt, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0015684b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-v5qllt",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
n/a passed n/a 0 n/a
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 5
e2e (5)
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
02:00:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
    <*fmt.wrapError | 0xc000e35000>: 
    failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-qglrql": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-qglrql/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-qglrql\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-qglrql/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc000e34fe0>{
            msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-qglrql\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-qglrql/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc001447260>{
                ErrorCode: "LockContention",
                StatusCode: 503,
                RawResponse: {
                    Status: "503 Service Unavailable",
                    StatusCode: 503,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
                        "X-Ms-Correlation-Request-Id": [
                            "b2f12524-b483-4738-8d44-7a5f46afb83d",
                        ],
                        "X-Ms-Routing-Request-Id": [
                            "UKSOUTH:20260330T021723Z:b2f12524-b483-4738-8d44-7a5f46afb83d",
                        ],
                        "X-Content-Type-Options": ["nosniff"],
                        "X-Ms-Request-Id": [
                            "dc418cf2-18ab-46ac-a971-610885d0613e",
                        ],
                        "X-Ms-Operation-Identifier": [
                            "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/d41fb8d4-f28c-45ed-970a-e96f3583b60e",
                        ],
                        "Cache-Control": ["no-cache"],
                        "Content-Length": ["186"],
                        "Strict-Transport-Security": [
                            "max-age=31536000; includeSubDomains",
                        ],
                        "Content-Type": ["application/json"],
                        "Expires": ["-1"],
                        "X-Ms-Error-Code": ["LockContention"],
                        "X-Ms-Failure-Cause": ["service"],
                        "X-Cache": ["CONFIG_NOCACHE"],
                        "X-Msedge-Ref": [
                            "Ref A: F8275E2F5A224754B818FC761EBD00E6 Ref B: CHI261140510031 Ref C: 2026-03-30T02:17:13Z",
                        ],
                        "Date": [
                            "Mon, 30 Mar 2026 02:17:23 GMT",
                       ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
    <*fmt.wrapError | 0xc000e35000>: 
    failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-qglrql": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-qglrql/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-qglrql\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-qglrql/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc000e34fe0>{
            msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-qglrql\": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-qglrql/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc001447260>{
                ErrorCode: "LockContention",
                StatusCode: 503,
                RawResponse: {
                    Status: "503 Service Unavailable",
                    StatusCode: 503,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
                        "X-Ms-Correlation-Request-Id": [
                            "b2f12524-b483-4738-8d44-7a5f46afb83d",
                        ],
                        "X-Ms-Routing-Request-Id": [
                            "UKSOUTH:20260330T021723Z:b2f12524-b483-4738-8d44-7a5f46afb83d",
                        ],
                        "X-Content-Type-Options": ["nosniff"],
                        "X-Ms-Request-Id": [
                            "dc418cf2-18ab-46ac-a971-610885d0613e",
                        ],
                        "X-Ms-Operation-Identifier": [
                            "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/d41fb8d4-f28c-45ed-970a-e96f3583b60e",
                        ],
                        "Cache-Control": ["no-cache"],
                        "Content-Length": ["186"],
                        "Strict-Transport-Security": [
                            "max-age=31536000; includeSubDomains",
                        ],
                        "Content-Type": ["application/json"],
                        "Expires": ["-1"],
                        "X-Ms-Error-Code": ["LockContention"],
                        "X-Ms-Failure-Cause": ["service"],
                        "X-Cache": ["CONFIG_NOCACHE"],
                        "X-Msedge-Ref": [
                            "Ref A: F8275E2F5A224754B818FC761EBD00E6 Ref B: CHI261140510031 Ref C: 2026-03-30T02:17:13Z",
                        ],
                        "Date": [
                            "Mon, 30 Mar 2026 02:17:23 GMT",
                       ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
02:00:16 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:94]: Unexpected error:
    <*fmt.wrapError | 0xc0009a2240>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-z7kqxx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-z7kqxx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc001452210>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Retry-After": ["10"],
                    "X-Ms-Request-Id": [
                        "bad8f67e-95d5-4627-9ade-5f4404fb64c1",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:34 GMT",
                    ],
                    "Content-Length": ["186"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Envoy-Upstream-Service-Time": ["10022"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/9626a40b-40ac-4fb0-8b06-04ed9b8c866f",
                    ],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021735Z:d50c9684-e91b-44fe-9754-322d764cfb29",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Correlation-Request-Id": [
                        "d50c9684-e91b-44fe-9754-322d764cfb29",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "X-Msedge-Ref": [
                        "Ref A: 25490A5A563241E3AB9615419CA0144E Ref B: CHI261140503029 Ref C: 2026-03-30T02:17:24Z",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc0009a20e0>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                Conte...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:94]: Unexpected error:
    <*fmt.wrapError | 0xc0009a2240>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-z7kqxx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-z7kqxx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc001452210>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Retry-After": ["10"],
                    "X-Ms-Request-Id": [
                        "bad8f67e-95d5-4627-9ade-5f4404fb64c1",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:34 GMT",
                    ],
                    "Content-Length": ["186"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Envoy-Upstream-Service-Time": ["10022"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/9626a40b-40ac-4fb0-8b06-04ed9b8c866f",
                    ],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021735Z:d50c9684-e91b-44fe-9754-322d764cfb29",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Correlation-Request-Id": [
                        "d50c9684-e91b-44fe-9754-322d764cfb29",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "X-Msedge-Ref": [
                        "Ref A: 25490A5A563241E3AB9615419CA0144E Ref B: CHI261140503029 Ref C: 2026-03-30T02:17:24Z",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc0009a20e0>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                Conte...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
02:00:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:157]: Unexpected error:
    <*fmt.wrapError | 0xc000e760c0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-pkkxdw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-pkkxdw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000dce1e0>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "Content-Length": ["186"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Content-Type-Options": ["nosniff"],
                    "Pragma": ["no-cache"],
                    "Retry-After": ["10"],
                    "X-Ms-Correlation-Request-Id": [
                        "37ef49af-09e9-40ee-bfca-efc082a80f64",
                    ],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021725Z:37ef49af-09e9-40ee-bfca-efc082a80f64",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Ms-Request-Id": [
                        "e0a372c3-fcdc-4ce9-bf08-e2fce9bc2797",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["10011"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/3345b2b1-e23f-4ce2-8dab-587f9642a08d",
                    ],
                    "X-Msedge-Ref": [
                        "Ref A: 93A8B2C021534273A8B574371656B5C5 Ref B: CH1AA2020620025 Ref C: 2026-03-30T02:17:14Z",
                    ],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:24 GMT",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000e76000>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
          ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:157]: Unexpected error:
    <*fmt.wrapError | 0xc000e760c0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-pkkxdw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-pkkxdw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-19/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000dce1e0>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "Content-Length": ["186"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Content-Type-Options": ["nosniff"],
                    "Pragma": ["no-cache"],
                    "Retry-After": ["10"],
                    "X-Ms-Correlation-Request-Id": [
                        "37ef49af-09e9-40ee-bfca-efc082a80f64",
                    ],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021725Z:37ef49af-09e9-40ee-bfca-efc082a80f64",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Ms-Request-Id": [
                        "e0a372c3-fcdc-4ce9-bf08-e2fce9bc2797",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["10011"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/3345b2b1-e23f-4ce2-8dab-587f9642a08d",
                    ],
                    "X-Msedge-Ref": [
                        "Ref A: 93A8B2C021534273A8B574371656B5C5 Ref B: CH1AA2020620025 Ref C: 2026-03-30T02:17:14Z",
                    ],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:24 GMT",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000e76000>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
          ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
02:00:16 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:106]: Unexpected error:
    <*fmt.wrapError | 0xc000dce100>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-6smz57/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-6smz57/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000d7a2d0>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021728Z:f051cbc0-873c-44c2-8914-5e59d922dd86",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Content-Type": ["application/json"],
                    "Retry-After": ["10"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/3ff18aa5-fc8a-478d-a260-ce0acf33be72",
                    ],
                    "X-Ms-Correlation-Request-Id": [
                        "f051cbc0-873c-44c2-8914-5e59d922dd86",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "Content-Length": ["186"],
                    "Expires": ["-1"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "X-Msedge-Ref": [
                        "Ref A: E71DB15DBD354DA688879002947B9080 Ref B: CHI261140506040 Ref C: 2026-03-30T02:17:18Z",
                    ],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:27 GMT",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Request-Id": [
                        "180208ba-d8e7-4063-898e-2652baca60d0",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["10014"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000dce040>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                Con...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:106]: Unexpected error:
    <*fmt.wrapError | 0xc000dce100>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-6smz57/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-6smz57/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000d7a2d0>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021728Z:f051cbc0-873c-44c2-8914-5e59d922dd86",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Content-Type": ["application/json"],
                    "Retry-After": ["10"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/3ff18aa5-fc8a-478d-a260-ce0acf33be72",
                    ],
                    "X-Ms-Correlation-Request-Id": [
                        "f051cbc0-873c-44c2-8914-5e59d922dd86",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "Content-Length": ["186"],
                    "Expires": ["-1"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "X-Msedge-Ref": [
                        "Ref A: E71DB15DBD354DA688879002947B9080 Ref B: CHI261140506040 Ref C: 2026-03-30T02:17:18Z",
                    ],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:27 GMT",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Request-Id": [
                        "180208ba-d8e7-4063-898e-2652baca60d0",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["10014"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000dce040>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                Con...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
02:00:16 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:101]: Unexpected error:
    <*fmt.wrapError | 0xc000880140>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-l5kcqt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-l5kcqt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0007c3020>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Msedge-Ref": [
                        "Ref A: E63E7F217AEF4A61B672EE993F0C845E Ref B: CHI261140503025 Ref C: 2026-03-30T02:17:16Z",
                    ],
                    "Content-Length": ["186"],
                    "Retry-After": ["10"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021727Z:bb11f99c-e03c-4b16-b311-aa38be6cadff",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Request-Id": [
                        "2be0babb-18d9-4e89-bfb9-4257725bcc2e",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["10012"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/a8dcc245-03b3-4a97-b825-733f0e66f8a8",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Correlation-Request-Id": [
                        "bb11f99c-e03c-4b16-b311-aa38be6cadff",
                    ],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:27 GMT",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000880060>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
      ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:101]: Unexpected error:
    <*fmt.wrapError | 0xc000880140>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-l5kcqt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-l5kcqt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0007c3020>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Msedge-Ref": [
                        "Ref A: E63E7F217AEF4A61B672EE993F0C845E Ref B: CHI261140503025 Ref C: 2026-03-30T02:17:16Z",
                    ],
                    "Content-Length": ["186"],
                    "Retry-After": ["10"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260330T021727Z:bb11f99c-e03c-4b16-b311-aa38be6cadff",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Request-Id": [
                        "2be0babb-18d9-4e89-bfb9-4257725bcc2e",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["10012"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=0e96dbb7-17a2-4393-b2d3-d84524e39c32/uksouth/a8dcc245-03b3-4a97-b825-733f0e66f8a8",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Correlation-Request-Id": [
                        "bb11f99c-e03c-4b16-b311-aa38be6cadff",
                    ],
                    "Date": [
                        "Mon, 30 Mar 2026 02:17:27 GMT",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000880060>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 57, 51, 57, 57, 50, 56, 49, 45, 48, 48, 97, 50, 45, 52, 98, 51, 57, 45, 98, 98, 51, 100, 45, 98, 50, 54, 52, 53, 98, 98, 98, 100, 98, 57, 51, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
      ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred