CIHealth
<
Single Day: Mar 28▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: INT

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 8
e2e (8)
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
04:21:07 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:104]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010863c0>: 
    failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-vng4qh" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-vng4qh, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-vng4qh\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-vng4qh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000739a40>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-vng4qh",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:104]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010863c0>: 
    failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-vng4qh" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-vng4qh, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-vng4qh\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-vng4qh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000739a40>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-vng4qh",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift
04:21:07 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:156]: Unexpected error:
    <*fmt.wrapError | 0xc0015c1140>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-p25bwm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-p25bwm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0013823c0>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Cache-Control": ["no-cache"],
                    "Content-Length": ["107"],
                    "Expires": ["-1"],
                    "X-Envoy-Upstream-Service-Time": ["155"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Msedge-Ref": [
                        "Ref A: 1A75AFB6FF1543BC912C50DE3AEF634E Ref B: CHI261140501031 Ref C: 2026-03-28T05:02:47Z",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T050247Z:5adbb814-f0df-46c4-bdef-ba86112797b5",
                    ],
                    "Date": [
                        "Sat, 28 Mar 2026 05:02:46 GMT",
                    ],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/fca0c457-3849-431d-bb5f-495bc34df4f0",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "997ac5fb-1a19-4f69-848c-6d9937ef5c49",
                    ],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Correlation-Request-Id": [
                        "5adbb814-f0df-46c4-bdef-ba86112797b5",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc0015c1080>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "management.azu...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:156]: Unexpected error:
    <*fmt.wrapError | 0xc0015c1140>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-p25bwm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-p25bwm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0013823c0>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Cache-Control": ["no-cache"],
                    "Content-Length": ["107"],
                    "Expires": ["-1"],
                    "X-Envoy-Upstream-Service-Time": ["155"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Msedge-Ref": [
                        "Ref A: 1A75AFB6FF1543BC912C50DE3AEF634E Ref B: CHI261140501031 Ref C: 2026-03-28T05:02:47Z",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T050247Z:5adbb814-f0df-46c4-bdef-ba86112797b5",
                    ],
                    "Date": [
                        "Sat, 28 Mar 2026 05:02:46 GMT",
                    ],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/fca0c457-3849-431d-bb5f-495bc34df4f0",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "997ac5fb-1a19-4f69-848c-6d9937ef5c49",
                    ],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Correlation-Request-Id": [
                        "5adbb814-f0df-46c4-bdef-ba86112797b5",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc0015c1080>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "management.azu...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
04:21:07 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:155]: Unexpected error:
    <*fmt.wrapErrors | 0xc001620fc0>: 
    failed waiting for hcpCluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-6nmp98" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-6nmp98, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-6nmp98\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-6nmp98, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e1e400>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-6nmp98",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:155]: Unexpected error:
    <*fmt.wrapErrors | 0xc001620fc0>: 
    failed waiting for hcpCluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-6nmp98" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-6nmp98, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-6nmp98\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-6nmp98, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e1e400>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-6nmp98",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
04:21:07 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d60960>: 
    failed waiting for hcpCluster="admin-cred-lifecycle-qhqkq5" in resourcegroup="admin-credential-lifecycle-test-xvcczx" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-qhqkq5 in resource group admin-credential-lifecycle-test-xvcczx, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-qhqkq5\" in resourcegroup=\"admin-credential-lifecycle-test-xvcczx\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-qhqkq5 in resource group admin-credential-lifecycle-test-xvcczx, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0014a07a0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-qhqkq5 in resource group admin-credential-lifecycle-test-xvcczx",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d60960>: 
    failed waiting for hcpCluster="admin-cred-lifecycle-qhqkq5" in resourcegroup="admin-credential-lifecycle-test-xvcczx" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-qhqkq5 in resource group admin-credential-lifecycle-test-xvcczx, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-qhqkq5\" in resourcegroup=\"admin-credential-lifecycle-test-xvcczx\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-qhqkq5 in resource group admin-credential-lifecycle-test-xvcczx, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0014a07a0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-qhqkq5 in resource group admin-credential-lifecycle-test-xvcczx",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift
04:21:07 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:127]: Unexpected error:
    <*fmt.wrapError | 0xc00099c5a0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-vwfd4n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-vwfd4n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000bd7710>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
                    "X-Ms-Correlation-Request-Id": [
                        "e794138c-c9f6-4add-80ad-6571d506b910",
                    ],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T045859Z:e794138c-c9f6-4add-80ad-6571d506b910",
                    ],
                    "X-Msedge-Ref": [
                        "Ref A: B7E389AEAC804AC69CDC01847C8D62C4 Ref B: CHI261140512023 Ref C: 2026-03-28T04:58:59Z",
                    ],
                    "Date": [
                        "Sat, 28 Mar 2026 04:58:59 GMT",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["200"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/50deffa5-9c24-449e-9277-2d607d537898",
                    ],
                    "Expires": ["-1"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Content-Length": ["107"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "4554592b-de8d-4bee-896b-b604d566cf6f",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc00099c4c0>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:127]: Unexpected error:
    <*fmt.wrapError | 0xc00099c5a0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-vwfd4n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-vwfd4n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000bd7710>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2998"],
                    "X-Ms-Correlation-Request-Id": [
                        "e794138c-c9f6-4add-80ad-6571d506b910",
                    ],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T045859Z:e794138c-c9f6-4add-80ad-6571d506b910",
                    ],
                    "X-Msedge-Ref": [
                        "Ref A: B7E389AEAC804AC69CDC01847C8D62C4 Ref B: CHI261140512023 Ref C: 2026-03-28T04:58:59Z",
                    ],
                    "Date": [
                        "Sat, 28 Mar 2026 04:58:59 GMT",
                    ],
                    "Pragma": ["no-cache"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["200"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/50deffa5-9c24-449e-9277-2d607d537898",
                    ],
                    "Expires": ["-1"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Content-Length": ["107"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "4554592b-de8d-4bee-896b-b604d566cf6f",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc00099c4c0>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift
04:21:07 UTC · failed at e2e · test Control plane automated z-stream upgrade with candidate channel should perform an automated control plane z-stream upgrade for 4.20 · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:110]: Unexpected error:
    <*fmt.wrapError | 0xc000886fe0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-k8s82w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-gsxqhp/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-k8s82w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-gsxqhp/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0006bc720>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Content-Type": ["application/json"],
                    "X-Msedge-Ref": [
                        "Ref A: 5C18A5E5865A447CAD257B2D17AC69BC Ref B: CHI261140511062 Ref C: 2026-03-28T05:01:46Z",
                    ],
                    "Expires": ["-1"],
                    "X-Ms-Request-Id": [
                        "b8001b45-128e-4419-b622-ebd59339ca7f",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["588"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T050147Z:2938cc51-e278-4bbf-8d54-92e75318a0ab",
                    ],
                    "Content-Length": ["107"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Date": [
                        "Sat, 28 Mar 2026 05:01:46 GMT",
                    ],
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/e2afbe11-ecaf-4b3c-9fb7-45c6d078ee48",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Correlation-Request-Id": [
                        "2938cc51-e278-4bbf-8d54-92e75318a0ab",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "Pragma": ["no-cache"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000886e40>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                   ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:110]: Unexpected error:
    <*fmt.wrapError | 0xc000886fe0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-k8s82w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-gsxqhp/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-k8s82w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-gsxqhp/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0006bc720>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Content-Type": ["application/json"],
                    "X-Msedge-Ref": [
                        "Ref A: 5C18A5E5865A447CAD257B2D17AC69BC Ref B: CHI261140511062 Ref C: 2026-03-28T05:01:46Z",
                    ],
                    "Expires": ["-1"],
                    "X-Ms-Request-Id": [
                        "b8001b45-128e-4419-b622-ebd59339ca7f",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["588"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T050147Z:2938cc51-e278-4bbf-8d54-92e75318a0ab",
                    ],
                    "Content-Length": ["107"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "Date": [
                        "Sat, 28 Mar 2026 05:01:46 GMT",
                    ],
                    "Cache-Control": ["no-cache"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/e2afbe11-ecaf-4b3c-9fb7-45c6d078ee48",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Correlation-Request-Id": [
                        "2938cc51-e278-4bbf-8d54-92e75318a0ab",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "Pragma": ["no-cache"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000886e40>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                   ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
04:21:07 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:101]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014b6e40>: 
    failed waiting for hcpCluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-29t7g9" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-29t7g9, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-np-labels-taints\" in resourcegroup=\"rg-np-labels-taints-29t7g9\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-29t7g9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000519a90>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-29t7g9",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:101]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014b6e40>: 
    failed waiting for hcpCluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-29t7g9" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-29t7g9, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-np-labels-taints\" in resourcegroup=\"rg-np-labels-taints-29t7g9\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-29t7g9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000519a90>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-29t7g9",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift
04:21:07 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:245]: Unexpected error:
    <*fmt.wrapError | 0xc00142e820>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-dx5m8p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-dx5m8p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000f6d110>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/c66aa752-673f-4628-a49d-7f7dc2d3356a",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Envoy-Upstream-Service-Time": ["1391"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "Date": [
                        "Sat, 28 Mar 2026 04:59:03 GMT",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Pragma": ["no-cache"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T045904Z:ca291777-485d-4eed-a3c7-ddd6e610ec6a",
                    ],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "X-Msedge-Ref": [
                        "Ref A: D9C07342F91B4429BBEAF84A0AE0B0F1 Ref B: CHI261140512034 Ref C: 2026-03-28T04:59:02Z",
                    ],
                    "Content-Length": ["107"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Ms-Request-Id": [
                        "65a9d924-f655-40d0-924f-18afcd4a7191",
                    ],
                    "X-Ms-Correlation-Request-Id": [
                        "ca291777-485d-4eed-a3c7-ddd6e610ec6a",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc00142e760>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "management.azur...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:245]: Unexpected error:
    <*fmt.wrapError | 0xc00142e820>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-dx5m8p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-dx5m8p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000f6d110>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/c66aa752-673f-4628-a49d-7f7dc2d3356a",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Envoy-Upstream-Service-Time": ["1391"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "X-Content-Type-Options": ["nosniff"],
                    "Date": [
                        "Sat, 28 Mar 2026 04:59:03 GMT",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Pragma": ["no-cache"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T045904Z:ca291777-485d-4eed-a3c7-ddd6e610ec6a",
                    ],
                    "X-Cache": ["CONFIG_NOCACHE"],
                    "X-Msedge-Ref": [
                        "Ref A: D9C07342F91B4429BBEAF84A0AE0B0F1 Ref B: CHI261140512034 Ref C: 2026-03-28T04:59:02Z",
                    ],
                    "Content-Length": ["107"],
                    "Content-Type": ["application/json"],
                    "Expires": ["-1"],
                    "X-Ms-Request-Id": [
                        "65a9d924-f655-40d0-924f-18afcd4a7191",
                    ],
                    "X-Ms-Correlation-Request-Id": [
                        "ca291777-485d-4eed-a3c7-ddd6e610ec6a",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0xc00142e760>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "management.azur...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
periodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 12
e2e (12)
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a8a300>: 
    failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-p66bx7" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-p66bx7, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-p66bx7\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-p66bx7, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000562950>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-p66bx7",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:103]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a8a300>: 
    failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-p66bx7" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-p66bx7, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-p66bx7\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-p66bx7, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000562950>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster ea-cluster in resource group external-auth-cluster-p66bx7",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:157]: Unexpected error:
    <*fmt.wrapErrors | 0xc001500f60>: 
    failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-56npwj" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-56npwj, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-56npwj\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-56npwj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000c18550>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-56npwj",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:157]: Unexpected error:
    <*fmt.wrapErrors | 0xc001500f60>: 
    failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-56npwj" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-56npwj, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-56npwj\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-56npwj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000c18550>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-56npwj",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e16600>: 
    failed waiting for hcpCluster="patch-name-cluster" in resourcegroup="patch-name-p9sn7q" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-name-cluster in resource group patch-name-p9sn7q, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-p9sn7q\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-name-cluster in resource group patch-name-p9sn7q, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000b955e0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-name-cluster in resource group patch-name-p9sn7q",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e16600>: 
    failed waiting for hcpCluster="patch-name-cluster" in resourcegroup="patch-name-p9sn7q" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-name-cluster in resource group patch-name-p9sn7q, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"patch-name-cluster\" in resourcegroup=\"patch-name-p9sn7q\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-name-cluster in resource group patch-name-p9sn7q, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000b955e0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-name-cluster in resource group patch-name-p9sn7q",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012f4330>: 
    failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-l4lmp2" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-l4lmp2, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-l4lmp2\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-l4lmp2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000c0e230>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-l4lmp2",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:185]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012f4330>: 
    failed waiting for hcpCluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-l4lmp2" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-l4lmp2, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-l4lmp2\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-l4lmp2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000c0e230>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-l4lmp2",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
ERROR CODE: InternalServerError; context ; provider Microsoft.RedHatOpenShift
01:15:12 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:245]: Unexpected error:
    <*fmt.wrapError | 0xc00086e8c0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-jswhmm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-jswhmm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000ee0d80>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Msedge-Ref": [
                        "Ref A: 743343FC5C9F457B801B7C1B2CA7B9FD Ref B: CHI261140514040 Ref C: 2026-03-28T02:00:45Z",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T020045Z:bcea0832-da4a-4642-a64a-a9c085824db7",
                    ],
                    "Date": [
                        "Sat, 28 Mar 2026 02:00:45 GMT",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["175"],
                    "X-Ms-Correlation-Request-Id": [
                        "bcea0832-da4a-4642-a64a-a9c085824db7",
                    ],
                    "Expires": ["-1"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Request-Id": [
                        "a89aca64-8b11-42fb-bf19-48fbcf84ee1d",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "Pragma": ["no-cache"],
                    "Content-Length": ["107"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/1f2a0296-bd43-4364-91ce-815963df37db",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc00086e800>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "management.azure...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:245]: Unexpected error:
    <*fmt.wrapError | 0xc00086e8c0>: 
    failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-jswhmm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 500: 500 Internal Server Error
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InternalServerError",
        "message": "Internal server error."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-jswhmm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 500: 500 Internal Server Error\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"Internal server error.\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc000ee0d80>{
            ErrorCode: "InternalServerError",
            StatusCode: 500,
            RawResponse: {
                Status: "500 Internal Server Error",
                StatusCode: 500,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Msedge-Ref": [
                        "Ref A: 743343FC5C9F457B801B7C1B2CA7B9FD Ref B: CHI261140514040 Ref C: 2026-03-28T02:00:45Z",
                    ],
                    "Cache-Control": ["no-cache"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Failure-Cause": ["service"],
                    "X-Ms-Ratelimit-Remaining-Subscription-Global-Writes": ["2999"],
                    "X-Ms-Routing-Request-Id": [
                        "UKSOUTH:20260328T020045Z:bcea0832-da4a-4642-a64a-a9c085824db7",
                    ],
                    "Date": [
                        "Sat, 28 Mar 2026 02:00:45 GMT",
                    ],
                    "X-Envoy-Upstream-Service-Time": ["175"],
                    "X-Ms-Correlation-Request-Id": [
                        "bcea0832-da4a-4642-a64a-a9c085824db7",
                    ],
                    "Expires": ["-1"],
                    "X-Ms-Error-Code": [
                        "InternalServerError",
                    ],
                    "X-Ms-Request-Id": [
                        "a89aca64-8b11-42fb-bf19-48fbcf84ee1d",
                    ],
                    "Strict-Transport-Security": [
                        "max-age=31536000; includeSubDomains",
                    ],
                    "Pragma": ["no-cache"],
                    "Content-Length": ["107"],
                    "X-Ms-Operation-Identifier": [
                        "appId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,tenantId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX,objectId=c209f8df-52ae-48fb-98ea-380f58b04652/uksouth/1f2a0296-bd43-4364-91ce-815963df37db",
                    ],
                    "X-Ms-Ratelimit-Remaining-Subscription-Writes": ["199"],
                    "X-Content-Type-Options": ["nosniff"],
                    "X-Cache": ["CONFIG_NOCACHE"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc00086e800>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 32, 115, 101, 114, 118, 101, 114, 32, 101, 114, 114, 111, 114, 46, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 107,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "management.azure...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:104]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013567e0>: 
    failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-zvrwbv" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-zvrwbv, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-zvrwbv\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-zvrwbv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0007097d0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-zvrwbv",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:104]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013567e0>: 
    failed waiting for hcpCluster="hcp-cluster-np-128" in resourcegroup="clusternp128-zvrwbv" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-zvrwbv, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-zvrwbv\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-zvrwbv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0007097d0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster hcp-cluster-np-128 in resource group clusternp128-zvrwbv",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
    <*fmt.wrapErrors | 0xc00053f740>: 
    failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-k9jkl2" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-k9jkl2, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-k9jkl2\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-k9jkl2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0009ef1f0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-k9jkl2",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
    <*fmt.wrapErrors | 0xc00053f740>: 
    failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-k9jkl2" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-k9jkl2, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-k9jkl2\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-k9jkl2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0009ef1f0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-k9jkl2",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc00144c090>: 
    failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-djgv9v" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-djgv9v, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-djgv9v\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-djgv9v, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d6e230>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-djgv9v",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc00144c090>: 
    failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-djgv9v" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-djgv9v, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-djgv9v\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-djgv9v, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d6e230>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-djgv9v",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
    <*fmt.wrapErrors | 0xc000febcb0>: 
    failed waiting for hcpCluster="admin-cred-lifecycle-lhbnlp" in resourcegroup="admin-credential-lifecycle-test-cxpsw5" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-lhbnlp in resource group admin-credential-lifecycle-test-cxpsw5, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-lhbnlp\" in resourcegroup=\"admin-credential-lifecycle-test-cxpsw5\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-lhbnlp in resource group admin-credential-lifecycle-test-cxpsw5, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0013775b0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-lhbnlp in resource group admin-credential-lifecycle-test-cxpsw5",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:174]: Unexpected error:
    <*fmt.wrapErrors | 0xc000febcb0>: 
    failed waiting for hcpCluster="admin-cred-lifecycle-lhbnlp" in resourcegroup="admin-credential-lifecycle-test-cxpsw5" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-lhbnlp in resource group admin-credential-lifecycle-test-cxpsw5, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-lhbnlp\" in resourcegroup=\"admin-credential-lifecycle-test-cxpsw5\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-lhbnlp in resource group admin-credential-lifecycle-test-cxpsw5, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0013775b0>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-lhbnlp in resource group admin-credential-lifecycle-test-cxpsw5",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:101]: Unexpected error:
    <*fmt.wrapErrors | 0xc000b00c90>: 
    failed waiting for hcpCluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-559vt6" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-559vt6, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-np-labels-taints\" in resourcegroup=\"rg-np-labels-taints-559vt6\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-559vt6, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000715380>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-559vt6",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:101]: Unexpected error:
    <*fmt.wrapErrors | 0xc000b00c90>: 
    failed waiting for hcpCluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-559vt6" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-559vt6, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-np-labels-taints\" in resourcegroup=\"rg-np-labels-taints-559vt6\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-559vt6, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000715380>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-559vt6",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:155]: Unexpected error:
    <*fmt.wrapErrors | 0xc00120c780>: 
    failed waiting for hcpCluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-dtdl96" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-dtdl96, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-dtdl96\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-dtdl96, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000379190>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-dtdl96",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:155]: Unexpected error:
    <*fmt.wrapErrors | 0xc00120c780>: 
    failed waiting for hcpCluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-dtdl96" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-dtdl96, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-dtdl96\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-dtdl96, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000379190>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster pullsecret-hcp-cluster in resource group pullsecret-test-dtdl96",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
01:15:12 UTC · failed at e2e · test HCP Nodepools GPU instances creates and deletes vm type NC4asT4v3 in a single cluster · suite integration/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:108]: Unexpected error:
    <*fmt.wrapErrors | 0xc001488420>: 
    failed waiting for hcpCluster="cluster-gpu-np" in resourcegroup="rg-gpu-nodepool-NC4asT4v3-5t87rp" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-gpu-np in resource group rg-gpu-nodepool-NC4asT4v3-5t87rp, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-gpu-np\" in resourcegroup=\"rg-gpu-nodepool-NC4asT4v3-5t87rp\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-gpu-np in resource group rg-gpu-nodepool-NC4asT4v3-5t87rp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d6ec40>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-gpu-np in resource group rg-gpu-nodepool-NC4asT4v3-5t87rp",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/gpu_nodepools_create_delete.go:108]: Unexpected error:
    <*fmt.wrapErrors | 0xc001488420>: 
    failed waiting for hcpCluster="cluster-gpu-np" in resourcegroup="rg-gpu-nodepool-NC4asT4v3-5t87rp" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-gpu-np in resource group rg-gpu-nodepool-NC4asT4v3-5t87rp, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-gpu-np\" in resourcegroup=\"rg-gpu-nodepool-NC4asT4v3-5t87rp\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-gpu-np in resource group rg-gpu-nodepool-NC4asT4v3-5t87rp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d6ec40>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-gpu-np in resource group rg-gpu-nodepool-NC4asT4v3-5t87rp",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred